-- Logs begin at Mon 2022-06-27 15:05:11 UTC, end at Mon 2022-06-27 16:10:12 UTC. -- Jun 27 15:39:09.322048 dv-cinder-847801-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 27 15:39:09.333386 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 27 15:39:09.335340 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 27 15:39:09 2022] *** Jun 27 15:39:09.335340 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 27 15:39:09.335340 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 27 15:39:09.335340 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: nodename: dv-cinder-847801-1-iscsi Jun 27 15:39:09.335340 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: machine: x86_64 Jun 27 15:39:09.335340 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: clock source: unix Jun 27 15:39:09.335340 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: pcre jit disabled Jun 27 15:39:09.335340 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: detected number of CPU cores: 4 Jun 27 15:39:09.335340 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: current working directory: / Jun 27 15:39:09.335340 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: detected binary path: /usr/bin/uwsgi-core Jun 27 15:39:09.335340 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: your processes number limit is 47680 Jun 27 15:39:09.335340 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: your memory page size is 4096 bytes Jun 27 15:39:09.335340 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: detected max file descriptor number: 2048 Jun 27 15:39:09.335340 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: lock engine: pthread robust mutexes Jun 27 15:39:09.336537 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: thunder lock: enabled Jun 27 15:39:09.336537 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 27 15:39:09.336537 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 27 15:39:09.385563 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: Python main interpreter initialized at 0x556bb6dd19c0 Jun 27 15:39:09.385563 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: python threads support enabled Jun 27 15:39:09.385563 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: your server socket listen backlog is limited to 100 connections Jun 27 15:39:09.385563 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: your mercy for graceful operations on workers is 90 seconds Jun 27 15:39:09.386009 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: mapped 403077 bytes (393 KB) for 2 cores Jun 27 15:39:09.386085 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: *** Operational MODE: preforking *** Jun 27 15:39:09.386328 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: *** uWSGI is running in multiple interpreter mode *** Jun 27 15:39:09.386328 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: spawned uWSGI master process (pid: 114942) Jun 27 15:39:09.386544 dv-cinder-847801-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 27 15:39:09.392230 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: spawned uWSGI worker 1 (pid: 114943, cores: 1) Jun 27 15:39:09.392230 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: spawned uWSGI worker 2 (pid: 114944, cores: 1) Jun 27 15:39:09.392230 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 27 15:39:10.077801 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 15:39:10.118080 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 15:39:11.233333 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:39:11.233333 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: from cryptography.utils import int_from_bytes Jun 27 15:39:11.234339 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:39:11.234339 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: from cryptography.utils import int_from_bytes Jun 27 15:39:11.241988 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:39:11.241988 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: from cryptography.utils import int_from_bytes Jun 27 15:39:11.242864 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:39:11.242864 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: from cryptography.utils import int_from_bytes Jun 27 15:39:13.801048 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 15:39:13.801959 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 15:39:13.802450 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 15:39:13.802563 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 15:39:13.802708 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 15:39:13.802840 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 15:39:13.802984 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 15:39:13.803121 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 15:39:13.803267 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 15:39:13.803396 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 15:39:13.803522 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.803648 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.803818 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.803947 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.804026 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.804092 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.804172 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.804314 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.804442 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.804560 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.804679 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.804679 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.804928 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.805058 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.805190 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.805325 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.805447 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.805569 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.805864 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.805996 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.806126 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.806260 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847801-1-iscsi {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.806398 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.806541 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.806666 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847801-1-iscsi {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.806792 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.806916 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.807041 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.807165 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.807320 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.807446 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.807589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.807715 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.807881 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.807993 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.808176 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.808265 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.808538 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.808685 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.810104 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.810241 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.810316 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.810390 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.810456 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.810532 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.810598 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.810691 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.810791 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.810923 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.811045 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.811166 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.811308 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.811435 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.811514 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.811580 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.811651 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.811737 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.811832 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.811900 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.812134 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.812246 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847801-1-iscsi {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.812448 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847801-1-iscsi {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.812595 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.812763 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.812862 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.813057 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.813153 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.813372 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.813472 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.813788 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.813909 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.814655 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.814812 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.814959 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.815129 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.815349 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.815593 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.815737 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.815974 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.816103 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.816211 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.816323 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.816732 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.816971 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.817212 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.817438 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.817694 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.817942 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.818156 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.818379 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.818583 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.818738 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.818893 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.819035 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.819197 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.819380 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.819588 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.819767 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.819980 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.820133 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.820273 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.820411 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.820561 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.820918 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.821067 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.821207 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.821354 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.821497 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.821659 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.821659 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.822171 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.822318 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.822457 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.822457 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.822813 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.822967 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.823116 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.823262 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.823401 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.823553 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.823693 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.823839 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.824012 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.824228 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.824459 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.824638 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.824779 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.824967 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.825185 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.825428 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.825808 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.826582 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.826770 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.827012 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.827236 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.827476 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.827716 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.827951 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.828123 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.828327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.828474 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.828622 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.828826 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.829348 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.829596 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.829956 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.830116 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.830273 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.830429 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.830571 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.830725 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.831068 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.831224 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.831375 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.831529 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.831747 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.831974 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.832204 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.832414 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.832660 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.832905 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.833143 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.833387 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.833620 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.833911 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.834159 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.834386 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.834611 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.834820 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.835065 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.835322 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.835322 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.835823 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.836190 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.836429 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.836429 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.836868 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.837086 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.837296 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.837499 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.837716 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.837866 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.837866 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.838223 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.838361 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.838499 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.838635 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.838635 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.838928 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.839074 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.839211 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.839354 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.839354 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.839632 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.839771 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.839914 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.840059 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.840059 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.840318 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.840463 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.840608 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.840757 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.840757 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.841036 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.841261 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.841421 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.841560 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.841720 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.841862 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.842000 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.842136 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.842289 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.842434 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.842580 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.842739 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.842878 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.843028 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.843177 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.843328 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.843328 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.843328 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.843328 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.843328 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.843328 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.843328 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.843328 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.844372 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.844372 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.844372 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.844372 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.844372 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.844372 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.844372 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.845258 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.845952 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.845952 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.846377 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.846609 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.846609 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.847045 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.847265 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.847265 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.847696 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.847937 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.847937 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.848224 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.848376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.848376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.848644 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.848790 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.848790 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.849050 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.849209 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.849355 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.849501 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.849674 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.849821 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.849821 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.850094 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.850242 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.850242 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.850507 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.850644 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.850644 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.850917 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.851066 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.851212 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.851474 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.851474 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.851755 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.851894 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.851894 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.852153 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.852301 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.852301 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.852569 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.852714 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.852714 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.853001 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.853139 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.853139 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.853408 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.853547 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.853547 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.853881 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.854019 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.854167 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.854306 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.854306 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.854573 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.854722 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.854722 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.854990 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.855129 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.855265 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.855402 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.855402 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.855660 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.855813 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.855955 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.856092 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.856228 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.856371 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.856545 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.856742 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.856742 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.857007 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.857158 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.857158 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.857419 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:39:13.857565 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.857565 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.857866 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.858011 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.858149 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.858301 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.858521 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.858759 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.858905 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.859071 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.859385 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.859542 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.859684 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.859995 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.860149 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.860292 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.860596 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.860752 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.860929 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.861241 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.861391 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.861705 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.861856 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.862176 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.862430 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.862584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.862787 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.863024 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.863170 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.863419 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.863564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.863714 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.864040 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.864186 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.864333 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.864635 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.864779 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.864942 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.865253 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.865398 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.865546 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.865756 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.865907 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.866165 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.866320 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.866467 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.866774 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.866919 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.867081 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.867384 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.867528 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.867704 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.867999 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.868156 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.868295 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.868558 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.868715 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.868888 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.869163 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.869311 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.869491 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.869810 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.869960 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.870112 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.870259 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.870428 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.870737 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.870882 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.871071 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.871401 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.871547 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.871708 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.872012 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.872158 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.872338 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.872564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.872720 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.872937 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.873080 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.873243 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.873544 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.873714 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.873881 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.874158 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.874303 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.874464 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.874755 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.874903 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.875049 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.875334 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.875481 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.875620 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.875912 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.876057 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.876229 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.876556 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.876705 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.876852 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.877170 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.877326 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.877724 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.877885 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.878026 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.878288 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.878434 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.878627 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.878882 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.879048 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.879263 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.879417 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.879581 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.879878 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.880024 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.880192 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.880467 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.880637 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.880778 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.881087 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.881241 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.881381 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.881684 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.881859 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.882041 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.882261 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.882410 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.882634 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.882851 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.883008 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.883245 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.883444 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.883600 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.883848 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.884034 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.884192 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.884483 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.884627 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.884811 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.885127 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.885280 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.885451 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.885727 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.885878 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.886086 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.886230 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.886381 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.886688 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.886844 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.886984 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.887289 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.887433 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.887585 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.887890 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.888038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.888203 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.888485 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.888642 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.888813 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.889096 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.889258 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.889418 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.889699 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.889862 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.890051 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.890325 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.890471 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.890689 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.890899 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.891059 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.891243 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.891390 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.891592 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.891790 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.891936 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.892752 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.892931 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.893233 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.893527 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.893842 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.894160 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.894319 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.894459 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.894743 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.894889 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.895073 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.895312 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.895461 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.895675 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.895915 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.896061 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.896288 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.896522 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.896672 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.896947 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.897100 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.897239 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.897492 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.897693 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.897852 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.897990 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.898146 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.898443 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.898603 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.898750 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.899032 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.899176 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.899352 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.899659 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.899815 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.899954 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.900247 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.900402 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.900550 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.900838 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.900994 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.901166 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.901374 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.901528 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.901790 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.902013 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.902179 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.902403 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.902604 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.902762 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.902981 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.903137 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.903308 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.903452 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.903624 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.903935 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.904078 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.904227 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.904503 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.904658 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.904830 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.905104 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.905268 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.905416 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.905749 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.905902 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.906064 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.906344 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.906490 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.906667 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.906904 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.907150 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.907310 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.907487 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.907644 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.908123 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.908474 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.908620 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.908888 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.909033 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.909241 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.909509 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.909677 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.909856 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.910174 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.910331 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.910505 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.910727 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.910873 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.911163 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.911318 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.911467 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.911765 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.911924 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.912072 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.912358 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.912502 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.912648 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.912954 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.913108 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.913260 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.913544 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.913729 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.913874 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.914159 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.914324 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.914465 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.914997 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.915143 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.915283 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.915566 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.915735 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.915875 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.916178 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.916333 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.916474 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.916754 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.916902 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.917077 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.917372 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.917529 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.917772 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.918028 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.918176 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.918326 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.918587 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.918744 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.918922 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.919199 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.919355 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.919575 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.919782 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.919928 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.920169 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.920374 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.920521 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.920779 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.920931 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.921091 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.921367 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.921513 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.921701 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.921992 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.922140 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.922278 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.922591 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.922749 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.922895 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.923196 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.923372 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.924134 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.924312 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.924459 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.924611 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.924845 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.925002 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.925188 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.925430 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.925584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.925804 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.926063 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.926226 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.926407 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.926654 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.926832 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.926980 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.927263 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.927508 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.927678 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.927832 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.927979 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.928146 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.928419 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.928573 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.928733 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.929023 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.929175 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.929341 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.929614 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.929842 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.930001 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.930255 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.930422 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.930569 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.930839 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.931069 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.931228 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.931413 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.931567 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.931712 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.932002 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.932163 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.932310 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.932535 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.932721 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.932905 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.933064 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.933223 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.933494 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.933736 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.933901 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.934109 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.934283 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.934430 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.934693 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.934851 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.934998 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.935277 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.935442 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.935595 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.935858 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.936010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.936177 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.936487 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.936652 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.936809 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.937074 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.937232 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.937380 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.937674 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.937857 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.938012 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.938276 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.938431 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.938653 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.938856 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.939038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.939380 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.939555 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.939702 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.939991 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.940153 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.940309 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.940587 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.940739 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.940894 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.941193 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.941354 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.941504 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.941681 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.941833 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.942099 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.942250 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.942419 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.942711 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.942871 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.943018 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.943286 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.943438 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.943623 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.943873 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.944025 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.944229 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.944449 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.944622 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.944828 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.944986 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.945140 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.945375 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.945535 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.945768 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.945998 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.946152 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.946323 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.946600 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.946752 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.946918 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.947186 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.947339 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.947514 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.947747 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.947907 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.948111 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.948335 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.948487 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.948717 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.948868 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.949027 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.949309 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.949469 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.949615 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.949929 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.950083 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.950241 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.950524 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.950676 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.950960 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.951115 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.951260 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.951565 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.951718 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.951864 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.952161 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.952319 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.952468 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.952769 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.952969 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.953118 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.953363 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.953537 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.953786 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.953965 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.954132 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.954386 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.954546 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.955295 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.955531 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.955682 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.955828 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.956085 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.956239 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.956529 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.956752 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.956925 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.957122 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.957288 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.957416 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.957767 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.958007 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.958161 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.958308 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.958453 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.958597 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.958751 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.958899 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.959044 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.959189 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.959335 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.959479 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.959740 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.959908 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.960055 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.960200 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.960347 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.960493 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.960652 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.960800 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.960953 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.961124 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.961276 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.961461 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.961629 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.961859 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.962022 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.962168 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.962310 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.962476 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.962623 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.962767 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.962917 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.963064 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.963208 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.963363 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.963606 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.963760 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.963906 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.964062 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.964208 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.964368 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.964522 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.964669 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.964812 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.965028 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.965203 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.965364 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.965511 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.965829 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.966155 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.966318 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.966544 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.966694 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.966846 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.967054 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.967222 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.967377 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.967651 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.967804 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.968030 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.968262 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.968414 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.968569 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.968859 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.969013 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.969160 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.969457 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.969615 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.969788 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.970075 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.970222 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.970472 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.971349 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.971471 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.971945 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.972051 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.972267 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.972509 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.972633 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.972875 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.972966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.973181 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.973508 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.973702 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.973843 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.974125 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.974228 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.974432 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.974693 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.974797 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.975061 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.975261 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.975354 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.975665 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.975843 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.975992 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.976319 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.976420 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.976627 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.976958 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.977083 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.977281 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.977540 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.977727 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.977918 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.978104 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.978240 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.978523 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.978620 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.978820 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.979122 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.979270 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.979407 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.979690 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.979835 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.979991 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.980271 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.980441 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.980558 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.980814 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.980916 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.981172 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.981430 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.981571 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.981767 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.982046 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.982173 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.982380 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.982614 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.982727 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.982975 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.983136 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.983264 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.983593 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.983696 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.983887 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.984222 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.984373 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.984522 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.984778 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.984934 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.985157 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.985401 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.985560 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.985794 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.986091 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.986429 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.986590 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.986741 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.986890 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.987048 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.987211 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.987498 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.987655 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.987802 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.988113 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.988278 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.988448 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.988714 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.988868 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.989015 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.989281 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.989453 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.989879 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.990037 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.990230 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.990468 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.990624 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.990846 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.991058 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.991219 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.991465 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.991619 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.991789 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.992076 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.992231 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.992375 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.992675 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.992789 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.992986 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.993301 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.993457 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.993753 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.993903 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.994010 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.994282 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.994474 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.994652 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.994910 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.995065 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.995215 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.995415 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.995569 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.995866 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.996026 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.996171 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.996450 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.996620 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.996771 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.997021 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.997181 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.997379 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.997595 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.997789 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.998016 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.998189 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.998413 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.998633 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.998780 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.998939 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.999098 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.999249 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.999531 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.999663 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:13.999841 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.000105 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.000275 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.000481 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.000675 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.000830 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.001102 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.001237 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.001422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.001795 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.001953 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.002328 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.002467 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.002635 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.002781 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.002960 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.003124 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.003270 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.003426 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.003588 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.003793 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.003943 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.004088 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.004233 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.004413 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.004560 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.004726 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.004875 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.005017 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.005372 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.005537 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.005721 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.005867 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.006012 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.006159 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.006304 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.006473 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.006630 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.006776 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.006940 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.007102 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.007248 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.007407 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.007553 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.007694 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.007838 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.007983 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.007983 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.008263 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.008404 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.008531 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.008739 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.008900 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.009056 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.009201 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.009431 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.009600 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.009791 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.009933 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.010100 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.010263 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.010410 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.010522 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.010627 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.010730 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.010822 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.010948 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.011074 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.011163 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.011245 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.011425 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.011527 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.011611 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.011698 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.011876 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.012051 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.012185 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.012362 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.012527 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.012682 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.012828 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.012973 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.013131 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.013276 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.013420 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.013567 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.013771 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.013978 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.014144 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.014291 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.014436 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.014596 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.014742 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.014898 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.015045 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.015189 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.015372 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.015526 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.015654 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.015812 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.015952 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.016095 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.016194 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.016290 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.016402 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.016553 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.016707 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.016833 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.016970 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.017116 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.017892 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.018051 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.018207 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.018353 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.018498 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.018752 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.019024 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.019195 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.019341 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.019487 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.019633 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.019743 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.019826 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.019975 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.020073 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.020284 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.020438 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.020584 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.020743 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.020888 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.021036 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.021182 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.021339 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.021484 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.021667 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.021797 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.021910 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.022107 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.022262 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.022422 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.022697 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.022860 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.023009 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.023153 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.023325 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.023487 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.023634 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.023780 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.023939 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.024070 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.024224 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.024390 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.024539 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.024678 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.024774 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.024844 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.025133 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.025249 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.025445 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.025734 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.025884 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.026032 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.026291 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.026437 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.026581 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.026738 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.026896 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.026989 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.027069 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.027151 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.027226 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.027369 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.027515 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.027667 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.027829 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.027974 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.028120 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.028265 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.028427 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.028581 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.028769 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.028950 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.029113 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.029260 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.029408 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.029580 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.029764 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.029924 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.030083 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.030233 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.030379 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.030548 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.030696 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.030845 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.030974 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.031053 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.031160 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.031319 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.031467 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.031627 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.031786 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.031931 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.032096 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.032243 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.032401 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.032521 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.032637 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.032811 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.032936 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.033729 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.033946 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.034157 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.034534 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.034690 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.034862 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.035006 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.035162 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.035318 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.035464 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.035621 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.035829 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.035980 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.036125 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.036271 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.036415 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.036574 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.036722 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.036876 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.037019 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.037170 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.037313 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.037471 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.037616 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.037922 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.038084 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.038200 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.038281 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.038375 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.038446 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.038539 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.038766 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.038992 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.039211 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.039370 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.039370 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.039883 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.040030 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.040177 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.040334 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.040479 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.040621 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.040765 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.040895 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.041037 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.041199 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.041346 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.041505 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.041723 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.041873 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.042038 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.042175 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.042320 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.042464 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.042611 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.042760 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.042889 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.043015 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.043161 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.043310 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.043455 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.043603 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.043758 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.043901 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.044048 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.044202 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.044283 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.044351 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.044453 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.044578 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.044717 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.044830 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.045021 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.045187 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.045332 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.045478 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.045624 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.045806 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.045935 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.046095 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.046231 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.046382 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.046517 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.046664 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.046840 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.047009 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.047160 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.047301 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.047450 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.047610 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.047758 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.047919 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.048067 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.048216 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.048364 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.048613 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.048797 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.048962 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.049111 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.049242 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.049414 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.049567 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.049818 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.049950 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.050038 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.050126 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.050357 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.050508 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.050667 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.050814 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.050961 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.051184 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.051343 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.051482 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.051644 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.051783 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.051932 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.052092 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.052240 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.052406 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.052554 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.052702 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.052849 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.052997 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.053140 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.053333 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.053471 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.053562 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.053686 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.053836 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.053983 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.054163 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.054323 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.054453 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.054653 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.054806 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.054935 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.055103 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.055198 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.055334 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.055481 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.055638 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.055796 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.055945 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.056076 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.056226 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.056353 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.056501 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.056663 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.056821 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.056965 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.057108 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.057254 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.057405 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.057575 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.057797 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.057948 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.058100 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.058248 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.058416 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.058563 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.058722 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.058869 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.059017 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.059165 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.059326 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.059454 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.059599 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.059744 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.059893 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.060052 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.060211 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.060358 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.060498 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.060598 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.060690 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 15:39:14.060837 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.061006 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.061304 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.061614 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.061956 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.062268 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.062834 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.063159 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.063471 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.063780 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.064146 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.064462 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.064779 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.065113 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.065395 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.065733 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.066044 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.066370 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.066689 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.067008 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.067345 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.067660 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.067971 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.068276 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.068588 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.068942 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.069255 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.069561 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.069894 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.070207 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.070517 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.070825 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.071132 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.071440 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.071745 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.072049 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.072353 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.072658 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.072966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.073285 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.073612 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.075033 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.075340 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.075655 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.075971 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.076528 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.076832 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.077165 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.077483 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.077906 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.078151 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.078461 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.078787 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.079089 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.079385 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.080248 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.080562 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.080947 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.081182 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.081491 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.081813 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.082128 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.082435 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.082978 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.083328 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.083644 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.083971 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.084294 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.084608 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.084941 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.085237 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.085537 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.085860 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.086174 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.086513 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.086884 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.087195 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.087512 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.087819 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.088121 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.088427 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.088724 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.089050 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.089356 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.089671 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.089976 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.090288 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.090594 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.090891 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.091189 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.091490 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.091801 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.092108 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.092415 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.092714 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.093017 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.093317 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.093621 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.093996 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.094315 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.094621 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.094921 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.095245 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.095632 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.095949 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.096266 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.096573 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.096916 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.097234 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.097821 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.098152 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.098473 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.098802 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.099130 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.099441 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.099743 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.100045 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.100357 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.100664 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.100977 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.101275 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.101582 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.101918 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.102221 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.102516 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.102827 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.103130 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.103431 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.103731 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.104034 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.104338 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.104646 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.104985 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.105522 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.105749 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.105918 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.106229 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.106539 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.106841 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.107145 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.107450 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.107761 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.108086 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.108392 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.108691 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.109113 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.109424 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.109758 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.110076 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.110379 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.110723 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.111645 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.111957 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.112274 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.112589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.112911 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.113248 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.113571 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.113917 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.114220 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.114522 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.114821 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.115127 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.115442 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.115745 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.116045 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.116349 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.116654 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.116953 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.117254 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.117553 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.117874 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.118180 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.118480 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.118777 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.119074 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.119372 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.119669 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.119965 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.120267 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.120565 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.120864 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.121163 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.121463 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.121790 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.122127 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.122454 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.122766 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.123085 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.123394 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.123714 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.124019 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.124338 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.124654 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.124972 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.125279 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.125621 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.125949 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.126270 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.127215 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.127761 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.128095 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.128410 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.128749 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.129075 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.129382 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.129737 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.130057 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.130379 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.130691 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.131000 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.131329 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.131636 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.131943 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.132256 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.132562 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.132867 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.133181 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.133490 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.133843 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.134165 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.134473 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.134795 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.135116 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.135470 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.135923 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.136152 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.136448 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.136760 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.137105 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.137369 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:39:14.137610 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 15:39:14.201658 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO dbcounter [None req-b908e7c9-5766-4fe3-93b8-4f98e01af032 None None] Registered counter for database nova_api Jun 27 15:39:14.232656 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO dbcounter [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] Registered counter for database nova_api Jun 27 15:39:14.258346 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_db.sqlalchemy.engines [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114943) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:39:14.267894 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG dbcounter [-] [114943] Writer thread running {{(pid=114943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:39:14.317683 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG oslo_db.sqlalchemy.engines [None req-b908e7c9-5766-4fe3-93b8-4f98e01af032 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:39:14.324579 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG dbcounter [-] [114944] Writer thread running {{(pid=114944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:39:14.358011 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.context [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),36cad6b8-e240-4e63-a1f3-ff7ac63edcb9(cell1) {{(pid=114943) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 15:39:14.362974 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:39:14.364656 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:39:14.365532 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:39:14.367645 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:39:14.369823 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO dbcounter [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] Registered counter for database nova_cell0 Jun 27 15:39:14.374488 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO dbcounter [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] Registered counter for database nova_cell1 Jun 27 15:39:14.382338 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_db.sqlalchemy.engines [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114943) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:39:14.384839 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_db.sqlalchemy.engines [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114943) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:39:14.389377 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG dbcounter [-] [114943] Writer thread running {{(pid=114943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:39:14.390393 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.context [None req-b908e7c9-5766-4fe3-93b8-4f98e01af032 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),36cad6b8-e240-4e63-a1f3-ff7ac63edcb9(cell1) {{(pid=114944) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 15:39:14.399236 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG oslo_concurrency.lockutils [None req-b908e7c9-5766-4fe3-93b8-4f98e01af032 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:39:14.403067 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG oslo_concurrency.lockutils [None req-b908e7c9-5766-4fe3-93b8-4f98e01af032 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:39:14.404325 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG oslo_concurrency.lockutils [None req-b908e7c9-5766-4fe3-93b8-4f98e01af032 None None] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:39:14.408330 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG oslo_concurrency.lockutils [None req-b908e7c9-5766-4fe3-93b8-4f98e01af032 None None] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:39:14.411152 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO dbcounter [None req-b908e7c9-5766-4fe3-93b8-4f98e01af032 None None] Registered counter for database nova_cell0 Jun 27 15:39:14.416033 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO dbcounter [None req-b908e7c9-5766-4fe3-93b8-4f98e01af032 None None] Registered counter for database nova_cell1 Jun 27 15:39:14.426150 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG oslo_db.sqlalchemy.engines [None req-b908e7c9-5766-4fe3-93b8-4f98e01af032 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:39:14.431692 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG dbcounter [-] [114944] Writer thread running {{(pid=114944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:39:14.432401 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG oslo_db.sqlalchemy.engines [None req-b908e7c9-5766-4fe3-93b8-4f98e01af032 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:39:14.543243 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG dbcounter [-] [114943] Writer thread running {{(pid=114943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:39:14.555671 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO dbcounter [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] Registered counter for database nova_cell0 Jun 27 15:39:14.565667 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_db.sqlalchemy.engines [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114943) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:39:14.571357 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG dbcounter [-] [114943] Writer thread running {{(pid=114943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:39:14.591067 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG dbcounter [-] [114944] Writer thread running {{(pid=114944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:39:14.603769 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO dbcounter [None req-b908e7c9-5766-4fe3-93b8-4f98e01af032 None None] Registered counter for database nova_cell0 Jun 27 15:39:14.612216 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG oslo_db.sqlalchemy.engines [None req-b908e7c9-5766-4fe3-93b8-4f98e01af032 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:39:14.617809 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG dbcounter [-] [114944] Writer thread running {{(pid=114944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:39:14.941785 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: WARNING keystonemiddleware.auth_token [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 15:39:14.948520 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: WARNING keystonemiddleware.auth_token [None req-b908e7c9-5766-4fe3-93b8-4f98e01af032 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 15:39:14.949256 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: WARNING keystonemiddleware.auth_token [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 15:39:14.956627 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: WARNING keystonemiddleware.auth_token [None req-b908e7c9-5766-4fe3-93b8-4f98e01af032 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 15:39:15.307821 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: WARNING keystonemiddleware.auth_token [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 15:39:15.308155 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: WARNING keystonemiddleware.auth_token [None req-b908e7c9-5766-4fe3-93b8-4f98e01af032 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 15:39:15.313941 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: WARNING keystonemiddleware.auth_token [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 15:39:15.314687 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: WARNING keystonemiddleware.auth_token [None req-b908e7c9-5766-4fe3-93b8-4f98e01af032 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 15:39:15.319863 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556bb6dd19c0 pid: 114944 (default app) Jun 27 15:39:15.320598 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556bb6dd19c0 pid: 114943 (default app) Jun 27 15:39:15.322110 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-b908e7c9-5766-4fe3-93b8-4f98e01af032 None None] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:39:15.323308 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-b908e7c9-5766-4fe3-93b8-4f98e01af032 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001915 Jun 27 15:39:15.323723 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Mon Jun 27 15:39:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:40:39.295462 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:39.298566 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003807 Jun 27 15:40:39.299470 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 27 15:40:39 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:40:39.318032 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG dbcounter [-] [114944] Writing DB stats nova_api:SELECT=3 {{(pid=114944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:40:39.318990 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG dbcounter [-] [114944] Writing DB stats nova_cell0:SELECT=3 {{(pid=114944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:40:39.319717 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG dbcounter [-] [114944] Writing DB stats nova_cell1:SELECT=3 {{(pid=114944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:40:39.320629 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG dbcounter [-] [114944] Writing DB stats nova_cell0:SELECT=3 {{(pid=114944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:40:39.850616 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-b72d3a2f-985a-48ed-bba0-e6021120dd2c admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:39.899464 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-b72d3a2f-985a-48ed-bba0-e6021120dd2c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.593236 Jun 27 15:40:39.906750 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Jun 27 15:40:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:40:42.050252 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:42.051650 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-6b8a1f0a-0f30-409a-8fbe-bbd9103da992 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001841 Jun 27 15:40:42.052314 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 2/4] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 27 15:40:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:40:42.120015 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-d63f26a7-1c1d-4a0c-8449-24519ea8c4f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "id": "c1"}} {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:40:42.139040 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:40:42.139040 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: warnings.warn(msg) Jun 27 15:40:42.174354 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-d63f26a7-1c1d-4a0c-8449-24519ea8c4f4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.115729 Jun 27 15:40:42.175382 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 3/5] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 27 15:40:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:40:42.190192 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG dbcounter [-] [114943] Writing DB stats nova_api:SELECT=3 {{(pid=114943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:40:42.191091 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG dbcounter [-] [114943] Writing DB stats nova_cell1:SELECT=3 {{(pid=114943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:40:42.192232 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG dbcounter [-] [114943] Writing DB stats nova_cell0:SELECT=3 {{(pid=114943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:40:42.193185 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG dbcounter [-] [114943] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:40:42.411902 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-b9128e93-ed5c-4f5e-9141-9a73d039c684 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:40:42.414299 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:40:42.414299 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: warnings.warn(msg) Jun 27 15:40:42.479014 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-b9128e93-ed5c-4f5e-9141-9a73d039c684 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.295373 Jun 27 15:40:42.479604 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 3/6] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jun 27 15:40:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:40:44.678475 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-d63f26a7-1c1d-4a0c-8449-24519ea8c4f4 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:44.679477 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-d63f26a7-1c1d-4a0c-8449-24519ea8c4f4 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 27 15:40:44.679897 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 4/7] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 27 15:40:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:40:44.786397 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-811870dd-bce9-42b3-a3ac-e345515360b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "d1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512}} {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:40:44.805382 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:40:44.805382 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: warnings.warn(msg) Jun 27 15:40:44.823551 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-811870dd-bce9-42b3-a3ac-e345515360b7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137753 Jun 27 15:40:44.830001 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 4/8] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 27 15:40:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:40:44.836275 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-c08298db-f77d-4fd2-8e89-f5a8921d5dac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:40:44.837786 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:40:44.837786 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: warnings.warn(msg) Jun 27 15:40:44.868995 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-c08298db-f77d-4fd2-8e89-f5a8921d5dac admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036192 Jun 27 15:40:44.869528 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 5/9] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jun 27 15:40:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:40:46.992549 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-811870dd-bce9-42b3-a3ac-e345515360b7 admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:46.993551 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-811870dd-bce9-42b3-a3ac-e345515360b7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 27 15:40:46.994249 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 27 15:40:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:40:47.056104 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-4d36bc30-04d4-436e-a69a-c64e01bac3b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10}} {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:40:47.078627 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-4d36bc30-04d4-436e-a69a-c64e01bac3b5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077135 Jun 27 15:40:47.079652 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 6/11] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 27 15:40:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:40:47.091115 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-dbe95f2a-457d-46b0-80b4-8c82aff5488c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:40:47.116478 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-dbe95f2a-457d-46b0-80b4-8c82aff5488c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028966 Jun 27 15:40:47.117275 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 6/12] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jun 27 15:40:47 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:40:49.250767 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-4d36bc30-04d4-436e-a69a-c64e01bac3b5 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:49.251783 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-4d36bc30-04d4-436e-a69a-c64e01bac3b5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 27 15:40:49.252180 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 7/13] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 27 15:40:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:40:49.315607 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-f01ad759-ffd9-458a-b353-7ee891124f79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d3", "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "ram": 2048}} {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:40:49.333411 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-f01ad759-ffd9-458a-b353-7ee891124f79 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075369 Jun 27 15:40:49.334065 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 7/14] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 27 15:40:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:40:49.346080 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-a869d876-472d-4f6f-8436-662e70438740 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:40:49.370612 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-a869d876-472d-4f6f-8436-662e70438740 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028200 Jun 27 15:40:49.371179 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 8/15] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jun 27 15:40:49 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:40:51.508873 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-f01ad759-ffd9-458a-b353-7ee891124f79 admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:51.509922 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-f01ad759-ffd9-458a-b353-7ee891124f79 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 27 15:40:51.510355 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 8/16] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 27 15:40:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:40:51.571126 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-2418237f-2304-4e91-ac4c-94f3f1e82efe admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4", "disk": 20}} {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:40:51.589010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-2418237f-2304-4e91-ac4c-94f3f1e82efe admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072331 Jun 27 15:40:51.589890 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 9/17] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 27 15:40:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:40:51.602187 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-c01e8b93-5b1f-44cb-af07-ef95a67a6cc4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:40:51.626459 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-c01e8b93-5b1f-44cb-af07-ef95a67a6cc4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027534 Jun 27 15:40:51.627254 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 9/18] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jun 27 15:40:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:40:53.767336 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-2418237f-2304-4e91-ac4c-94f3f1e82efe admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:53.768558 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-2418237f-2304-4e91-ac4c-94f3f1e82efe admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 27 15:40:53.769214 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 10/19] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 27 15:40:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:40:53.833203 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-06c8d40c-66f2-44d4-b43e-2223f27206e9 admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:53.857903 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-06c8d40c-66f2-44d4-b43e-2223f27206e9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082520 Jun 27 15:40:53.859382 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 10/20] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Jun 27 15:40:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:40:56.045951 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-2418237f-2304-4e91-ac4c-94f3f1e82efe admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:56.046968 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-2418237f-2304-4e91-ac4c-94f3f1e82efe admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jun 27 15:40:56.047649 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 11/21] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 27 15:40:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:40:56.110012 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-49e1535d-37c3-4389-b9ea-97553714a926 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "ram": 512, "id": "1"}} {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:40:56.129583 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-49e1535d-37c3-4389-b9ea-97553714a926 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075064 Jun 27 15:40:56.130164 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 11/22] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 27 15:40:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:40:56.144958 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-fe946c10-01f2-4d81-a8ca-78ad411b3bcf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:40:56.171373 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-fe946c10-01f2-4d81-a8ca-78ad411b3bcf admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030254 Jun 27 15:40:56.171969 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 12/23] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jun 27 15:40:56 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:40:58.301378 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-49e1535d-37c3-4389-b9ea-97553714a926 admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:58.303091 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-49e1535d-37c3-4389-b9ea-97553714a926 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002203 Jun 27 15:40:58.303679 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 27 15:40:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:40:58.367558 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-300f02d9-1597-46c5-ac03-134bfe342102 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "vcpus": 1, "swap": 0, "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:40:58.390600 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-300f02d9-1597-46c5-ac03-134bfe342102 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080219 Jun 27 15:40:58.391441 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 13/25] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 27 15:40:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:40:58.410249 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-b2d8e74e-d429-4e6f-888b-3807bf126508 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:40:58.435068 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-b2d8e74e-d429-4e6f-888b-3807bf126508 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029016 Jun 27 15:40:58.435594 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 13/26] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jun 27 15:40:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:41:00.809983 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-300f02d9-1597-46c5-ac03-134bfe342102 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:00.811096 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-300f02d9-1597-46c5-ac03-134bfe342102 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Jun 27 15:41:00.811401 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 14/27] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 27 15:41:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:41:00.876045 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-c677d128-02f3-488a-b027-216f82d3d1c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "ram": 4096, "rxtx_factor": 1.0, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium"}} {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:41:00.895871 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-c677d128-02f3-488a-b027-216f82d3d1c7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.077746 Jun 27 15:41:00.896424 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 14/28] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 27 15:41:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:41:00.908981 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-1442119d-1c6a-40ce-bc1b-4522fe4f7417 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:41:00.941706 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-1442119d-1c6a-40ce-bc1b-4522fe4f7417 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036946 Jun 27 15:41:00.942292 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 15/29] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jun 27 15:41:00 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:41:03.080326 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-c677d128-02f3-488a-b027-216f82d3d1c7 admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:03.081375 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-c677d128-02f3-488a-b027-216f82d3d1c7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 27 15:41:03.081972 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 15/30] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 27 15:41:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:41:03.143755 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-999ed4e2-74d6-4bec-970b-ac0e56922a93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "swap": 0, "ram": 8192, "name": "m1.large", "id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:41:03.162902 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-999ed4e2-74d6-4bec-970b-ac0e56922a93 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074998 Jun 27 15:41:03.163457 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 16/31] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 27 15:41:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:41:03.177328 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-3e5e6459-26cd-4ecd-a066-bdb3a65cbf78 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:41:03.203988 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-3e5e6459-26cd-4ecd-a066-bdb3a65cbf78 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030217 Jun 27 15:41:03.204582 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 16/32] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jun 27 15:41:03 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:41:05.358047 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-999ed4e2-74d6-4bec-970b-ac0e56922a93 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:05.359826 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-999ed4e2-74d6-4bec-970b-ac0e56922a93 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002286 Jun 27 15:41:05.360822 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 17/33] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 27 15:41:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:41:05.451308 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-2bdeeb04-abca-46a9-bbd5-2a19a2f1fe69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true}} {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:41:05.474609 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-2bdeeb04-abca-46a9-bbd5-2a19a2f1fe69 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.104948 Jun 27 15:41:05.475680 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 17/34] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jun 27 15:41:05 2022] POST /compute/v2.1/flavors => generated 408 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:41:05.490635 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-fe474bdf-776c-4ac8-a2e7-af5883bfe2a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:41:05.519852 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-fe474bdf-776c-4ac8-a2e7-af5883bfe2a2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033905 Jun 27 15:41:05.520553 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 18/35] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jun 27 15:41:05 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:41:30.903236 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-2bdeeb04-abca-46a9-bbd5-2a19a2f1fe69 admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:30.904247 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-2bdeeb04-abca-46a9-bbd5-2a19a2f1fe69 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 27 15:41:30.904641 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 18/36] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 27 15:41:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:41:30.915129 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG dbcounter [-] [114944] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=114944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:41:30.964283 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-8ea30de0-2ab0-4009-b8b7-c8b5c31c86d5 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:30.981706 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-8ea30de0-2ab0-4009-b8b7-c8b5c31c86d5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071034 Jun 27 15:41:30.982239 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 19/37] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Jun 27 15:41:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:41:31.939284 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-2bdeeb04-abca-46a9-bbd5-2a19a2f1fe69 admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:31.940287 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-2bdeeb04-abca-46a9-bbd5-2a19a2f1fe69 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 27 15:41:31.940688 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 19/38] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 27 15:41:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:41:32.138344 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-b3b85aed-8408-4ef4-a8f0-5b066957daa6 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:32.145602 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.wsgi [None req-b3b85aed-8408-4ef4-a8f0-5b066957daa6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-b3b85aed-8408-4ef4-a8f0-5b066957daa6 admin admin] Request method failure captured: Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Accept: application/json Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Accept-Encoding: gzip, deflate Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Connection: keep-alive Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Content-Length: 0 Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Host: 10.222.0.20 Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Openstack-Api-Version: compute 2.90 Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Openstack-System-Scope: None Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: User-Agent: python-novaclient Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Auth-Token: gAAAAABiuc-r0eraqUbBD0VLcUpHt79KSv3yBVIx3x-xublWL5Zez2KcNIc10aU-TPgLess8BgxxeGb7Cfn8hJk4-i9F0sTeNSLp9JQAuWm4x_WBChrEngV-5NkBbyMQBsrqlOK5icfSJeEDi5hM94WdqUWkii65jde68J1L035vYgPmkAhk0-I Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Domain-Id: None Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Domain-Name: None Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Identity-Status: Confirmed Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Is-Admin-Project: True Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Project-Domain-Id: default Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Project-Domain-Name: Default Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Project-Id: 53048925682f4806b3831f88058d3439 Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Project-Name: admin Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Role: reader,admin,member Jun 27 15:41:32.150564 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Roles: reader,admin,member Jun 27 15:41:32.152706 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53048925682f4806b3831f88058d3439"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/53048925682f4806b3831f88058d3439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53048925682f4806b3831f88058d3439"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_53048925682f4806b3831f88058d3439", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:41:32.152706 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Tenant: admin Jun 27 15:41:32.152706 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Tenant-Id: 53048925682f4806b3831f88058d3439 Jun 27 15:41:32.152706 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Tenant-Name: admin Jun 27 15:41:32.152706 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-User: admin Jun 27 15:41:32.152706 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-User-Domain-Id: default Jun 27 15:41:32.152706 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-User-Domain-Name: Default Jun 27 15:41:32.152706 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-User-Id: 4b433ad0233c4e5dbe8fad9896962e25 Jun 27 15:41:32.152706 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-User-Name: admin Jun 27 15:41:32.152706 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: method: > Jun 27 15:41:32.152706 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: exception: Flavor 42 could not be found. Jun 27 15:41:32.152706 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: action_args: {'id': '42'} Jun 27 15:41:32.152706 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:41:32.152706 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:41:32.154010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 15:41:32.154010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 15:41:32.154010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 15:41:32.154010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 15:41:32.154010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 15:41:32.154010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 15:41:32.154010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 15:41:32.154010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 15:41:32.154010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 15:41:32.154010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:41:32.154010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 15:41:32.154010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 15:41:32.154010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 27 15:41:32.154010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Jun 27 15:41:32.154010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:41:32.154010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Jun 27 15:41:32.154010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:41:32.154010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:41:32.154010 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:41:32.156540 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:41:32.156540 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:41:32.156540 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:41:32.156540 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:41:32.156540 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 15:41:32.156540 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:41:32.156540 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 27 15:41:32.156540 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Jun 27 15:41:32.156540 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:41:32.156540 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Jun 27 15:41:32.156540 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:41:32.156540 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:41:32.156540 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:41:32.156540 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:41:32.156540 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:41:32.156540 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 27 15:41:32.156540 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Jun 27 15:41:32.156540 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-b3b85aed-8408-4ef4-a8f0-5b066957daa6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:41:32.159015 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-b3b85aed-8408-4ef4-a8f0-5b066957daa6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.071532 Jun 27 15:41:32.159015 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 20/39] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Jun 27 15:41:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 15:41:32.162925 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-5f59e153-506f-4474-85a4-57323787c0cf admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:32.166020 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG dbcounter [-] [114943] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=114943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:41:32.186361 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-5f59e153-506f-4474-85a4-57323787c0cf admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026988 Jun 27 15:41:32.186934 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jun 27 15:41:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:41:32.196795 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-469b4e54-4b01-467e-83bf-a4568c1075c1 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:32.219215 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-469b4e54-4b01-467e-83bf-a4568c1075c1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025925 Jun 27 15:41:32.219785 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jun 27 15:41:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:41:32.230075 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-e9d3400e-65d8-4c92-b1e8-672b43cd5c11 admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:32.237263 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.wsgi [None req-e9d3400e-65d8-4c92-b1e8-672b43cd5c11 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-e9d3400e-65d8-4c92-b1e8-672b43cd5c11 admin admin] Request method failure captured: Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Accept: application/json Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Accept-Encoding: gzip, deflate Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Connection: keep-alive Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Content-Length: 0 Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Host: 10.222.0.20 Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Openstack-Api-Version: compute 2.90 Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Openstack-System-Scope: None Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: User-Agent: python-novaclient Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Auth-Token: gAAAAABiuc-r0eraqUbBD0VLcUpHt79KSv3yBVIx3x-xublWL5Zez2KcNIc10aU-TPgLess8BgxxeGb7Cfn8hJk4-i9F0sTeNSLp9JQAuWm4x_WBChrEngV-5NkBbyMQBsrqlOK5icfSJeEDi5hM94WdqUWkii65jde68J1L035vYgPmkAhk0-I Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Domain-Id: None Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Domain-Name: None Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Identity-Status: Confirmed Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Is-Admin-Project: True Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Project-Domain-Id: default Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Project-Domain-Name: Default Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Project-Id: 53048925682f4806b3831f88058d3439 Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Project-Name: admin Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Role: reader,admin,member Jun 27 15:41:32.240584 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Roles: reader,admin,member Jun 27 15:41:32.241995 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53048925682f4806b3831f88058d3439"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/53048925682f4806b3831f88058d3439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53048925682f4806b3831f88058d3439"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_53048925682f4806b3831f88058d3439", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:41:32.241995 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Tenant: admin Jun 27 15:41:32.241995 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Tenant-Id: 53048925682f4806b3831f88058d3439 Jun 27 15:41:32.241995 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Tenant-Name: admin Jun 27 15:41:32.241995 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-User: admin Jun 27 15:41:32.241995 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-User-Domain-Id: default Jun 27 15:41:32.241995 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-User-Domain-Name: Default Jun 27 15:41:32.241995 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-User-Id: 4b433ad0233c4e5dbe8fad9896962e25 Jun 27 15:41:32.241995 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-User-Name: admin Jun 27 15:41:32.241995 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: method: > Jun 27 15:41:32.241995 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: exception: Flavor 42 could not be found. Jun 27 15:41:32.241995 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: action_args: {'id': '42'} Jun 27 15:41:32.241995 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:41:32.241995 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:41:32.246038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 15:41:32.246038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 15:41:32.246038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 15:41:32.246038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 15:41:32.246038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 15:41:32.246038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 15:41:32.246038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 15:41:32.246038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 15:41:32.246038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 15:41:32.246038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:41:32.246038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 15:41:32.246038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 15:41:32.246038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 27 15:41:32.246038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Jun 27 15:41:32.246038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:41:32.246038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Jun 27 15:41:32.246038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:41:32.246038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:41:32.246038 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:41:32.247327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:41:32.247327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:41:32.247327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:41:32.247327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:41:32.247327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 15:41:32.247327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:41:32.247327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 27 15:41:32.247327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Jun 27 15:41:32.247327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:41:32.247327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Jun 27 15:41:32.247327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:41:32.247327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:41:32.247327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:41:32.247327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:41:32.247327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:41:32.247327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 27 15:41:32.247327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Jun 27 15:41:32.247327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-e9d3400e-65d8-4c92-b1e8-672b43cd5c11 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114943) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:41:32.248512 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-e9d3400e-65d8-4c92-b1e8-672b43cd5c11 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016268 Jun 27 15:41:32.248512 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 21/42] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Jun 27 15:41:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 27 15:41:33.078198 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-469b4e54-4b01-467e-83bf-a4568c1075c1 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:33.079155 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-469b4e54-4b01-467e-83bf-a4568c1075c1 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002124 Jun 27 15:41:33.079557 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 22/43] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 27 15:41:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:41:33.270443 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-34e346e3-18c6-41a2-98c8-578101d77d03 admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:33.277928 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.wsgi [None req-34e346e3-18c6-41a2-98c8-578101d77d03 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-34e346e3-18c6-41a2-98c8-578101d77d03 admin admin] Request method failure captured: Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Accept: application/json Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Accept-Encoding: gzip, deflate Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Connection: keep-alive Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Content-Length: 0 Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Host: 10.222.0.20 Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Openstack-Api-Version: compute 2.90 Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Openstack-System-Scope: None Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: User-Agent: python-novaclient Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Auth-Token: gAAAAABiuc-tQWPJm6wcWTbcxrSE7TjJvQZ1R4Dy4IzydC6DSstxJA1JhkvlhMJsDlKO6bAkJrB8PbxewRHOq0rIBEpaY2_7hecJtVyRm3hqWpYxJLEn2nVVDdG9TsAGgWVP3vXBx5E6FehZbVsFHXUdiKfcv41HlQmkWoZt0XWXjOrOXg4xyVU Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Domain-Id: None Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Domain-Name: None Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Identity-Status: Confirmed Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Is-Admin-Project: True Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Project-Domain-Id: default Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Project-Domain-Name: Default Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Project-Id: 53048925682f4806b3831f88058d3439 Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Project-Name: admin Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Role: reader,admin,member Jun 27 15:41:33.279422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Roles: reader,admin,member Jun 27 15:41:33.281561 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53048925682f4806b3831f88058d3439"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/53048925682f4806b3831f88058d3439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53048925682f4806b3831f88058d3439"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_53048925682f4806b3831f88058d3439", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:41:33.281561 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Tenant: admin Jun 27 15:41:33.281561 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Tenant-Id: 53048925682f4806b3831f88058d3439 Jun 27 15:41:33.281561 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Tenant-Name: admin Jun 27 15:41:33.281561 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-User: admin Jun 27 15:41:33.281561 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-User-Domain-Id: default Jun 27 15:41:33.281561 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-User-Domain-Name: Default Jun 27 15:41:33.281561 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-User-Id: 4b433ad0233c4e5dbe8fad9896962e25 Jun 27 15:41:33.281561 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-User-Name: admin Jun 27 15:41:33.281561 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: method: > Jun 27 15:41:33.281561 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: exception: Flavor 84 could not be found. Jun 27 15:41:33.281561 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: action_args: {'id': '84'} Jun 27 15:41:33.281561 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:41:33.281561 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:41:33.282399 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 15:41:33.282399 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 15:41:33.282399 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 15:41:33.282399 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 15:41:33.282399 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 15:41:33.282399 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 15:41:33.282399 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 15:41:33.282399 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 15:41:33.282399 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 15:41:33.282399 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:41:33.282399 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 15:41:33.282399 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 15:41:33.282399 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 27 15:41:33.282399 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Jun 27 15:41:33.282399 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:41:33.282399 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Jun 27 15:41:33.282399 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:41:33.282399 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:41:33.282399 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:41:33.283413 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:41:33.283413 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:41:33.283413 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:41:33.283413 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:41:33.283413 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 15:41:33.283413 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:41:33.283413 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 27 15:41:33.283413 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Jun 27 15:41:33.283413 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:41:33.283413 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Jun 27 15:41:33.283413 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:41:33.283413 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:41:33.283413 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:41:33.283413 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:41:33.283413 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:41:33.283413 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 27 15:41:33.283413 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Jun 27 15:41:33.283413 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-34e346e3-18c6-41a2-98c8-578101d77d03 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114943) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:41:33.284422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-34e346e3-18c6-41a2-98c8-578101d77d03 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061530 Jun 27 15:41:33.284422 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 22/44] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Jun 27 15:41:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 15:41:33.290977 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-642b1cca-1eab-452f-be9d-390d04af57ea admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:33.306059 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-642b1cca-1eab-452f-be9d-390d04af57ea admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018556 Jun 27 15:41:33.306625 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jun 27 15:41:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:41:33.316476 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-b28722a1-7d16-46c3-a5c9-f6e46b0f403a admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:33.330885 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-b28722a1-7d16-46c3-a5c9-f6e46b0f403a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017909 Jun 27 15:41:33.331427 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jun 27 15:41:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:41:33.340923 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-8e030b01-5c44-4cd1-9ef8-2e4690bad31e admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:33.347459 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.wsgi [None req-8e030b01-5c44-4cd1-9ef8-2e4690bad31e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-8e030b01-5c44-4cd1-9ef8-2e4690bad31e admin admin] Request method failure captured: Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Accept: application/json Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Accept-Encoding: gzip, deflate Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Connection: keep-alive Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Content-Length: 0 Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Host: 10.222.0.20 Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Openstack-Api-Version: compute 2.90 Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Openstack-System-Scope: None Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: User-Agent: python-novaclient Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Auth-Token: gAAAAABiuc-tQWPJm6wcWTbcxrSE7TjJvQZ1R4Dy4IzydC6DSstxJA1JhkvlhMJsDlKO6bAkJrB8PbxewRHOq0rIBEpaY2_7hecJtVyRm3hqWpYxJLEn2nVVDdG9TsAGgWVP3vXBx5E6FehZbVsFHXUdiKfcv41HlQmkWoZt0XWXjOrOXg4xyVU Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Domain-Id: None Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Domain-Name: None Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Identity-Status: Confirmed Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Is-Admin-Project: True Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Project-Domain-Id: default Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Project-Domain-Name: Default Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Project-Id: 53048925682f4806b3831f88058d3439 Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Project-Name: admin Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Role: reader,admin,member Jun 27 15:41:33.348966 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Roles: reader,admin,member Jun 27 15:41:33.350513 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53048925682f4806b3831f88058d3439"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/53048925682f4806b3831f88058d3439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53048925682f4806b3831f88058d3439"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_53048925682f4806b3831f88058d3439", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:41:33.350513 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Tenant: admin Jun 27 15:41:33.350513 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Tenant-Id: 53048925682f4806b3831f88058d3439 Jun 27 15:41:33.350513 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Tenant-Name: admin Jun 27 15:41:33.350513 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-User: admin Jun 27 15:41:33.350513 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-User-Domain-Id: default Jun 27 15:41:33.350513 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-User-Domain-Name: Default Jun 27 15:41:33.350513 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-User-Id: 4b433ad0233c4e5dbe8fad9896962e25 Jun 27 15:41:33.350513 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-User-Name: admin Jun 27 15:41:33.350513 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: method: > Jun 27 15:41:33.350513 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: exception: Flavor 84 could not be found. Jun 27 15:41:33.350513 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: action_args: {'id': '84'} Jun 27 15:41:33.350513 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:41:33.350513 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:41:33.351324 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 15:41:33.351324 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 15:41:33.351324 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 15:41:33.351324 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 15:41:33.351324 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 15:41:33.351324 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 15:41:33.351324 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 15:41:33.351324 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 15:41:33.351324 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 15:41:33.351324 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:41:33.351324 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 15:41:33.351324 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 15:41:33.351324 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 27 15:41:33.351324 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Jun 27 15:41:33.351324 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:41:33.351324 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Jun 27 15:41:33.351324 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:41:33.351324 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:41:33.351324 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:41:33.352393 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:41:33.352393 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:41:33.352393 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:41:33.352393 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:41:33.352393 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 15:41:33.352393 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:41:33.352393 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 27 15:41:33.352393 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Jun 27 15:41:33.352393 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:41:33.352393 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Jun 27 15:41:33.352393 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:41:33.352393 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:41:33.352393 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:41:33.352393 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:41:33.352393 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:41:33.352393 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 27 15:41:33.352393 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Jun 27 15:41:33.352393 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-8e030b01-5c44-4cd1-9ef8-2e4690bad31e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:41:33.353362 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-8e030b01-5c44-4cd1-9ef8-2e4690bad31e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013189 Jun 27 15:41:33.353362 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 24/47] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Jun 27 15:41:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 15:41:34.187920 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-b28722a1-7d16-46c3-a5c9-f6e46b0f403a admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:34.188921 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-b28722a1-7d16-46c3-a5c9-f6e46b0f403a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jun 27 15:41:34.189313 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 24/48] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 27 15:41:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:41:34.380200 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-87c00290-4531-45a8-b432-6b3f88aa6bdf admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:34.386650 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.wsgi [None req-87c00290-4531-45a8-b432-6b3f88aa6bdf admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-87c00290-4531-45a8-b432-6b3f88aa6bdf admin admin] Request method failure captured: Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Accept: application/json Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Accept-Encoding: gzip, deflate Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Connection: keep-alive Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Content-Length: 0 Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Host: 10.222.0.20 Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Openstack-Api-Version: compute 2.90 Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Openstack-System-Scope: None Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: User-Agent: python-novaclient Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Auth-Token: gAAAAABiuc-uCMJnriP6zsasRjDaW6R-gf2oRphN701MX8braVyZUFxpVLu_p8Jb7gpUF5TUBUVWj_GjovRbNvAq4ny4StkHwy_PNVKUycYwS5zhauosQ4hqIV9eCkzNusC3eNi3CqO-FO41glwwdak1cuSH9QA2RSowEwVEmDVeXqoejgsg38o Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Domain-Id: None Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Domain-Name: None Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Identity-Status: Confirmed Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Is-Admin-Project: True Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Project-Domain-Id: default Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Project-Domain-Name: Default Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Project-Id: 53048925682f4806b3831f88058d3439 Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Project-Name: admin Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Role: reader,admin,member Jun 27 15:41:34.388204 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Roles: reader,admin,member Jun 27 15:41:34.390279 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53048925682f4806b3831f88058d3439"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/53048925682f4806b3831f88058d3439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53048925682f4806b3831f88058d3439"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_53048925682f4806b3831f88058d3439", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:41:34.390279 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Tenant: admin Jun 27 15:41:34.390279 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Tenant-Id: 53048925682f4806b3831f88058d3439 Jun 27 15:41:34.390279 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-Tenant-Name: admin Jun 27 15:41:34.390279 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-User: admin Jun 27 15:41:34.390279 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-User-Domain-Id: default Jun 27 15:41:34.390279 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-User-Domain-Name: Default Jun 27 15:41:34.390279 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-User-Id: 4b433ad0233c4e5dbe8fad9896962e25 Jun 27 15:41:34.390279 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: X-User-Name: admin Jun 27 15:41:34.390279 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: method: > Jun 27 15:41:34.390279 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: exception: Flavor 451 could not be found. Jun 27 15:41:34.390279 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: action_args: {'id': '451'} Jun 27 15:41:34.390279 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:41:34.390279 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:41:34.391282 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 15:41:34.391282 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 15:41:34.391282 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 15:41:34.391282 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 15:41:34.391282 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 15:41:34.391282 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 15:41:34.391282 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 15:41:34.391282 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 15:41:34.391282 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 15:41:34.391282 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:41:34.391282 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 15:41:34.391282 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 15:41:34.391282 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 27 15:41:34.391282 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Jun 27 15:41:34.391282 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:41:34.391282 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Jun 27 15:41:34.391282 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:41:34.391282 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:41:34.391282 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:41:34.392589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:41:34.392589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:41:34.392589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:41:34.392589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:41:34.392589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 15:41:34.392589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:41:34.392589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 27 15:41:34.392589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Jun 27 15:41:34.392589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:41:34.392589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Jun 27 15:41:34.392589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:41:34.392589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:41:34.392589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:41:34.392589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:41:34.392589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:41:34.392589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 27 15:41:34.392589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: ERROR nova.api.openstack.wsgi Jun 27 15:41:34.392589 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-87c00290-4531-45a8-b432-6b3f88aa6bdf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:41:34.393856 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-87c00290-4531-45a8-b432-6b3f88aa6bdf admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061322 Jun 27 15:41:34.393856 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 25/49] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jun 27 15:41:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 15:41:34.400586 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-6dfe911b-9f70-4edd-a01c-fa27ba54f191 admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:34.415501 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-6dfe911b-9f70-4edd-a01c-fa27ba54f191 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018669 Jun 27 15:41:34.416073 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 25/50] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jun 27 15:41:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:41:34.426094 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-15af5909-842d-4966-942d-b96ea72eef46 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:34.439729 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-15af5909-842d-4966-942d-b96ea72eef46 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017144 Jun 27 15:41:34.440266 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 26/51] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jun 27 15:41:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:41:34.449814 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-54f4a106-ae39-4c17-b645-5ae2580541da admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:34.455839 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.wsgi [None req-54f4a106-ae39-4c17-b645-5ae2580541da admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-54f4a106-ae39-4c17-b645-5ae2580541da admin admin] Request method failure captured: Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Accept: application/json Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Accept-Encoding: gzip, deflate Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Connection: keep-alive Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Content-Length: 0 Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Host: 10.222.0.20 Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Openstack-Api-Version: compute 2.90 Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Openstack-System-Scope: None Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: User-Agent: python-novaclient Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Auth-Token: gAAAAABiuc-uCMJnriP6zsasRjDaW6R-gf2oRphN701MX8braVyZUFxpVLu_p8Jb7gpUF5TUBUVWj_GjovRbNvAq4ny4StkHwy_PNVKUycYwS5zhauosQ4hqIV9eCkzNusC3eNi3CqO-FO41glwwdak1cuSH9QA2RSowEwVEmDVeXqoejgsg38o Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Domain-Id: None Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Domain-Name: None Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Identity-Status: Confirmed Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Is-Admin-Project: True Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Project-Domain-Id: default Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Project-Domain-Name: Default Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Project-Id: 53048925682f4806b3831f88058d3439 Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Project-Name: admin Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Role: reader,admin,member Jun 27 15:41:34.457327 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Roles: reader,admin,member Jun 27 15:41:34.458892 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53048925682f4806b3831f88058d3439"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/53048925682f4806b3831f88058d3439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53048925682f4806b3831f88058d3439"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_53048925682f4806b3831f88058d3439", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:41:34.458892 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Tenant: admin Jun 27 15:41:34.458892 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Tenant-Id: 53048925682f4806b3831f88058d3439 Jun 27 15:41:34.458892 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-Tenant-Name: admin Jun 27 15:41:34.458892 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-User: admin Jun 27 15:41:34.458892 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-User-Domain-Id: default Jun 27 15:41:34.458892 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-User-Domain-Name: Default Jun 27 15:41:34.458892 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-User-Id: 4b433ad0233c4e5dbe8fad9896962e25 Jun 27 15:41:34.458892 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: X-User-Name: admin Jun 27 15:41:34.458892 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: method: > Jun 27 15:41:34.458892 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: exception: Flavor 451 could not be found. Jun 27 15:41:34.458892 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: action_args: {'id': '451'} Jun 27 15:41:34.458892 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:41:34.458892 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:41:34.460033 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 15:41:34.460033 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 15:41:34.460033 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 15:41:34.460033 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 15:41:34.460033 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 15:41:34.460033 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 15:41:34.460033 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 15:41:34.460033 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 15:41:34.460033 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 15:41:34.460033 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:41:34.460033 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 15:41:34.460033 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 15:41:34.460033 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 27 15:41:34.460033 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Jun 27 15:41:34.460033 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:41:34.460033 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Jun 27 15:41:34.460033 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:41:34.460033 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:41:34.460033 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:41:34.461376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:41:34.461376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:41:34.461376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:41:34.461376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:41:34.461376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 15:41:34.461376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:41:34.461376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 27 15:41:34.461376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Jun 27 15:41:34.461376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:41:34.461376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Jun 27 15:41:34.461376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:41:34.461376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:41:34.461376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:41:34.461376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:41:34.461376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:41:34.461376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 27 15:41:34.461376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: ERROR nova.api.openstack.wsgi Jun 27 15:41:34.461376 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-54f4a106-ae39-4c17-b645-5ae2580541da admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114943) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:41:34.462679 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-54f4a106-ae39-4c17-b645-5ae2580541da admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012494 Jun 27 15:41:34.462679 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 26/52] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jun 27 15:41:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 15:41:35.300834 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-15af5909-842d-4966-942d-b96ea72eef46 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:35.301879 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-15af5909-842d-4966-942d-b96ea72eef46 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 27 15:41:35.302295 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 27 15:41:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:41:35.496626 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-bad2a2f2-9804-453c-b925-567d14b07958 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:41:35.515820 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-bad2a2f2-9804-453c-b925-567d14b07958 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072903 Jun 27 15:41:35.516352 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 27/54] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Jun 27 15:41:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:41:36.378259 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-15af5909-842d-4966-942d-b96ea72eef46 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:36.379257 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-15af5909-842d-4966-942d-b96ea72eef46 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 27 15:41:36.379649 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 27 15:41:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:41:36.572202 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-6d754b16-0a90-4f58-8005-cc3d45ea8112 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:41:36.591632 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-6d754b16-0a90-4f58-8005-cc3d45ea8112 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.073435 Jun 27 15:41:36.592179 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 28/56] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Jun 27 15:41:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:41:37.436215 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-15af5909-842d-4966-942d-b96ea72eef46 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:37.437208 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-15af5909-842d-4966-942d-b96ea72eef46 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Jun 27 15:41:37.437599 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 29/57] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 27 15:41:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:41:37.637177 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-236ef7d5-629c-4ef7-ab3d-b4c38c613458 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:41:37.655040 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-236ef7d5-629c-4ef7-ab3d-b4c38c613458 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070546 Jun 27 15:41:37.655526 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 29/58] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Jun 27 15:41:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:41:38.518616 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-15af5909-842d-4966-942d-b96ea72eef46 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:38.519639 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-15af5909-842d-4966-942d-b96ea72eef46 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 27 15:41:38.520032 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 30/59] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 27 15:41:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:41:38.717089 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-8ede4df4-0429-4d71-aab0-764f9407037a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:41:38.735722 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-8ede4df4-0429-4d71-aab0-764f9407037a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.075349 Jun 27 15:41:38.736276 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 30/60] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Jun 27 15:41:38 2022] POST /compute/v2.1/flavors => generated 409 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:41:39.595651 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-15af5909-842d-4966-942d-b96ea72eef46 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:39.596655 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-15af5909-842d-4966-942d-b96ea72eef46 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 27 15:41:39.597060 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 31/61] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 27 15:41:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:41:39.797080 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-6ff268b3-1e85-4084-81a0-ad80aab2bc50 admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:39.817363 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-6ff268b3-1e85-4084-81a0-ad80aab2bc50 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073828 Jun 27 15:41:39.817841 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 31/62] 10.222.0.20 () {60 vars in 1202 bytes} [Mon Jun 27 15:41:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:42:30.387519 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-15af5909-842d-4966-942d-b96ea72eef46 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:42:30.388551 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-15af5909-842d-4966-942d-b96ea72eef46 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 27 15:42:30.388978 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jun 27 15:42:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:42:30.400648 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG dbcounter [-] [114943] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=114943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:42:30.450928 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-7bb6b637-dc74-4694-b35f-b2286e6843cb admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:42:30.471445 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-7bb6b637-dc74-4694-b35f-b2286e6843cb admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075381 Jun 27 15:42:30.472002 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 32/64] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Jun 27 15:42:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:42:30.494550 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-ad642b07-8362-4c85-8783-0037a8ee4feb admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:42:30.498174 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG dbcounter [-] [114944] Writing DB stats nova_api:SELECT=14 {{(pid=114944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:42:30.503638 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-ad642b07-8362-4c85-8783-0037a8ee4feb admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012659 Jun 27 15:42:30.504178 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 33/65] 10.222.0.20 () {60 vars in 1282 bytes} [Mon Jun 27 15:42:30 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:42:30.516415 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-5428bbf8-19fa-4ac0-bcb7-cd0993a70c07 admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:42:30.524157 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-5428bbf8-19fa-4ac0-bcb7-cd0993a70c07 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012099 Jun 27 15:42:30.524694 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 33/66] 10.222.0.20 () {60 vars in 1285 bytes} [Mon Jun 27 15:42:30 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:42:30.537070 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-08e11d0f-9559-4f17-ad27-bb6446246971 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:42:30.545059 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-08e11d0f-9559-4f17-ad27-bb6446246971 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011840 Jun 27 15:42:30.545614 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 34/67] 10.222.0.20 () {60 vars in 1285 bytes} [Mon Jun 27 15:42:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:42:30.557444 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-4a0ecfa1-b92b-470f-90b7-92495d067388 admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:42:30.565355 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-4a0ecfa1-b92b-470f-90b7-92495d067388 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011475 Jun 27 15:42:30.565937 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 34/68] 10.222.0.20 () {60 vars in 1282 bytes} [Mon Jun 27 15:42:30 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:45:52.986260 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-08e11d0f-9559-4f17-ad27-bb6446246971 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:45:52.987271 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-08e11d0f-9559-4f17-ad27-bb6446246971 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 Jun 27 15:45:52.987677 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 35/69] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 27 15:45:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:45:53.128528 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG dbcounter [-] [114943] Writing DB stats nova_api:SELECT=6 {{(pid=114943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:45:53.245056 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-95d2f69d-4075-405b-a31b-340d73ce179a admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:45:53.246910 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:45:53.246910 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: warnings.warn(msg) Jun 27 15:45:53.248098 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-95d2f69d-4075-405b-a31b-340d73ce179a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:45:53.248535 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-95d2f69d-4075-405b-a31b-340d73ce179a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:45:53.249302 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-95d2f69d-4075-405b-a31b-340d73ce179a admin admin] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:45:53.249748 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-95d2f69d-4075-405b-a31b-340d73ce179a admin admin] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:45:53.283524 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-95d2f69d-4075-405b-a31b-340d73ce179a admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.156554 Jun 27 15:45:53.284107 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 35/70] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jun 27 15:45:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:45:54.115928 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-08e11d0f-9559-4f17-ad27-bb6446246971 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:45:54.116924 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-08e11d0f-9559-4f17-ad27-bb6446246971 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jun 27 15:45:54.117329 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 27 15:45:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:45:54.310689 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-23022423-cb4a-4b54-95d7-a141fde96b14 admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:45:54.311898 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:45:54.311898 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: warnings.warn(msg) Jun 27 15:45:54.313091 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-23022423-cb4a-4b54-95d7-a141fde96b14 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:45:54.313534 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-23022423-cb4a-4b54-95d7-a141fde96b14 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:45:54.314343 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-23022423-cb4a-4b54-95d7-a141fde96b14 admin admin] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:45:54.314773 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-23022423-cb4a-4b54-95d7-a141fde96b14 admin admin] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:45:54.334929 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-23022423-cb4a-4b54-95d7-a141fde96b14 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078533 Jun 27 15:45:54.335425 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 36/72] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jun 27 15:45:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:46:05.646827 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-08e11d0f-9559-4f17-ad27-bb6446246971 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:46:05.647833 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-08e11d0f-9559-4f17-ad27-bb6446246971 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 27 15:46:05.648261 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 37/73] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 27 15:46:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:46:05.803941 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG dbcounter [-] [114943] Writing DB stats nova_cell0:SELECT=4 {{(pid=114943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:46:05.804695 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG dbcounter [-] [114943] Writing DB stats nova_cell1:SELECT=4 {{(pid=114943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:46:05.805358 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG dbcounter [-] [114943] Writing DB stats nova_api:SELECT=8 {{(pid=114943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:46:05.857126 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-e11a4835-f531-497a-a535-a09f57f74e16 admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:46:05.858277 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:46:05.858277 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: warnings.warn(msg) Jun 27 15:46:05.859500 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-e11a4835-f531-497a-a535-a09f57f74e16 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:46:05.860298 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-e11a4835-f531-497a-a535-a09f57f74e16 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:46:05.860720 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-e11a4835-f531-497a-a535-a09f57f74e16 admin admin] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:46:05.861146 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-e11a4835-f531-497a-a535-a09f57f74e16 admin admin] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:46:05.887477 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-e11a4835-f531-497a-a535-a09f57f74e16 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087991 Jun 27 15:46:05.888047 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 37/74] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jun 27 15:46:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:46:06.733788 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: DEBUG nova.api.openstack.wsgi [None req-08e11d0f-9559-4f17-ad27-bb6446246971 admin admin] Calling method '>' {{(pid=114944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:46:06.734794 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: INFO nova.api.openstack.requestlog [None req-08e11d0f-9559-4f17-ad27-bb6446246971 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 27 15:46:06.735185 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: [pid: 114944|app: 0|req: 38/75] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jun 27 15:46:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:46:06.927976 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG nova.api.openstack.wsgi [None req-8d30588e-337b-4a58-ba3d-3bf6fa54025c admin admin] Calling method '>' {{(pid=114943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:46:06.929133 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:46:06.929133 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: warnings.warn(msg) Jun 27 15:46:06.930343 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-8d30588e-337b-4a58-ba3d-3bf6fa54025c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:46:06.930778 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-8d30588e-337b-4a58-ba3d-3bf6fa54025c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:46:06.931549 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-8d30588e-337b-4a58-ba3d-3bf6fa54025c admin admin] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:46:06.931994 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: DEBUG oslo_concurrency.lockutils [None req-8d30588e-337b-4a58-ba3d-3bf6fa54025c admin admin] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:46:06.953985 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: INFO nova.api.openstack.requestlog [None req-8d30588e-337b-4a58-ba3d-3bf6fa54025c admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078614 Jun 27 15:46:06.954475 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: [pid: 114943|app: 0|req: 38/76] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jun 27 15:46:06 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:47:03.159502 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: Mon Jun 27 15:47:03 2022 - graceful shutdown triggered... Jun 27 15:47:03.159253 dv-cinder-847801-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 27 15:47:03.160476 dv-cinder-847801-1-iscsi devstack@n-api.service[114944]: Gracefully killing worker 2 (pid: 114944)... Jun 27 15:47:03.160846 dv-cinder-847801-1-iscsi devstack@n-api.service[114943]: Gracefully killing worker 1 (pid: 114943)... Jun 27 15:47:04.160283 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: worker 1 buried after 1 seconds Jun 27 15:47:04.160870 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: worker 2 buried after 1 seconds Jun 27 15:47:04.160870 dv-cinder-847801-1-iscsi devstack@n-api.service[114942]: goodbye to uWSGI. Jun 27 15:47:04.161951 dv-cinder-847801-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 27 15:47:04.162503 dv-cinder-847801-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 27 15:47:04.165467 dv-cinder-847801-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 27 15:47:04.178598 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 27 15:47:04.181135 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 27 15:47:04 2022] *** Jun 27 15:47:04.181135 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 27 15:47:04.181135 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 27 15:47:04.181135 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: nodename: dv-cinder-847801-1-iscsi Jun 27 15:47:04.181135 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: machine: x86_64 Jun 27 15:47:04.181135 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: clock source: unix Jun 27 15:47:04.181135 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: pcre jit disabled Jun 27 15:47:04.181135 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: detected number of CPU cores: 4 Jun 27 15:47:04.181135 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: current working directory: / Jun 27 15:47:04.181135 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: detected binary path: /usr/bin/uwsgi-core Jun 27 15:47:04.181135 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: your processes number limit is 47680 Jun 27 15:47:04.181135 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: your memory page size is 4096 bytes Jun 27 15:47:04.181135 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: detected max file descriptor number: 2048 Jun 27 15:47:04.181135 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: lock engine: pthread robust mutexes Jun 27 15:47:04.182203 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: thunder lock: enabled Jun 27 15:47:04.182203 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 27 15:47:04.182203 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 27 15:47:04.231387 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: Python main interpreter initialized at 0x555d6e6ec9c0 Jun 27 15:47:04.231387 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: python threads support enabled Jun 27 15:47:04.231387 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: your server socket listen backlog is limited to 100 connections Jun 27 15:47:04.231387 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: your mercy for graceful operations on workers is 90 seconds Jun 27 15:47:04.231843 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: mapped 403077 bytes (393 KB) for 2 cores Jun 27 15:47:04.231843 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: *** Operational MODE: preforking *** Jun 27 15:47:04.232112 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: *** uWSGI is running in multiple interpreter mode *** Jun 27 15:47:04.232112 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: spawned uWSGI master process (pid: 129454) Jun 27 15:47:04.232341 dv-cinder-847801-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 27 15:47:04.232946 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: spawned uWSGI worker 1 (pid: 129472, cores: 1) Jun 27 15:47:04.236774 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: spawned uWSGI worker 2 (pid: 129473, cores: 1) Jun 27 15:47:04.236774 dv-cinder-847801-1-iscsi devstack@n-api.service[129454]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 27 15:47:04.901261 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 15:47:04.905321 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 15:47:06.276760 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:47:06.276760 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: from cryptography.utils import int_from_bytes Jun 27 15:47:06.277544 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:47:06.277544 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: from cryptography.utils import int_from_bytes Jun 27 15:47:06.302324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:47:06.302324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: from cryptography.utils import int_from_bytes Jun 27 15:47:06.302924 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:47:06.302924 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: from cryptography.utils import int_from_bytes Jun 27 15:47:08.756783 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 15:47:08.757805 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 15:47:08.758661 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 15:47:08.759316 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 15:47:08.759800 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 15:47:08.760422 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.760966 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.761604 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.762290 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.762877 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.763429 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.763975 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.764520 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.765067 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.765562 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.766153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.766698 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847801-1-iscsi {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.767246 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.767771 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.768259 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.768605 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.768927 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.769265 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.769586 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.770141 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.771612 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.771612 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.771612 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.771612 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.771953 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.772203 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.772480 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.772789 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.773126 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.773449 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.773902 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847801-1-iscsi {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.774767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.775089 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.775412 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.775854 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.776166 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.776504 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.776813 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.777122 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.777432 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.777811 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.778139 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.778485 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.778789 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.779098 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.779410 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.779723 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.780049 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.780360 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.780669 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.780925 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.781236 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.781565 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.781933 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.782264 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.782521 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.782776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.783098 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.783422 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.783740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.784053 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.784362 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.784673 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.784984 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.785293 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.785602 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.785940 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.786266 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.786584 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.786912 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.787223 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.787545 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.787955 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.788211 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.788521 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.788867 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.789193 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.789505 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.789914 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 15:47:08.790903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.790903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.791072 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.791377 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.791581 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 15:47:08.791734 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.791966 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 15:47:08.792122 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.792318 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.792516 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 15:47:08.792673 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 15:47:08.792821 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.792970 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.793118 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.793268 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.793411 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.793578 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.793795 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.793948 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.794112 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.794273 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.794424 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.794565 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.794713 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.794861 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.795012 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.795163 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.795323 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.795477 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.795637 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.795793 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.796208 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.796362 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.796511 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.796651 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.796844 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847801-1-iscsi {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.796998 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.797148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.797308 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.797460 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.797609 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.797773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.797937 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.798105 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.798259 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.798400 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.798559 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.798710 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.798858 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.799007 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.799157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.799157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.799469 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.799658 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.799825 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.800632 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.800784 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.800784 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.801071 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.801221 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.801370 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.801510 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.801697 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.802301 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.802449 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.802590 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.802730 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.802889 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.803030 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.803182 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.803330 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.803478 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.803625 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.803775 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847801-1-iscsi {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.803926 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.804574 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.805090 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.809573 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.809940 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.810253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.810949 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.810949 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.811263 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.811423 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.811568 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.811721 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.813063 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.813239 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.813397 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.813545 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.813716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.813883 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.814040 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.814183 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.814183 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.814183 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.814607 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.814758 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.815115 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.816890 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.817673 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.817853 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.818020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.818167 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.818309 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.818462 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.818605 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.818746 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.818904 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.819047 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.819233 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.819389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.823809 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.824004 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.824172 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.824172 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.824470 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.824968 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.825125 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.825284 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.825428 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.825792 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.825951 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.827471 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.828247 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.828410 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.828560 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.828731 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.828886 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.829031 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.829182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.829331 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.829536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.832240 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.833007 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.833172 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.833327 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.833477 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.833477 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.833808 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.833951 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.834094 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.834236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.834400 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.834554 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.834696 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.834984 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.835152 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.835304 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.836278 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.836446 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.836591 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.836819 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.836965 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.837254 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.837414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.837565 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.837769 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.837913 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.838065 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.838226 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.839491 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.839662 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.839808 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.839963 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.840152 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.840354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.840541 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.840713 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.840863 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.841057 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.844372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.844494 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.844597 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.844689 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.844773 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.844856 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.844950 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.845044 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.845129 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.845222 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.845313 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.845403 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.845487 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.845583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.845725 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.845813 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.845813 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.845981 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.846078 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.846172 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.846172 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.846172 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.846434 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.846434 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.846610 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.846696 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.846782 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.846875 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.846965 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.847048 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.847140 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.847223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.847313 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.847404 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.847494 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.847584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.847675 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.847768 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.847858 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.847941 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.848023 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.848115 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.848213 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.848296 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.848384 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.848479 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.848562 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.848657 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.848747 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.848841 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.848933 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.849018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.849100 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.849191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.849282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.849372 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.849462 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.849546 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.849667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.849766 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.849858 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.849858 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.850019 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.850114 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.850199 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.850290 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.850381 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.850465 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.850554 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.850715 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.850810 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.850902 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.850987 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.850987 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.851153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.851250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.851362 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.851475 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.851575 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.851673 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.851774 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.851874 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.851966 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.852059 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.852149 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.852233 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.855335 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.855447 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.855586 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.855681 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.855766 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.855859 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.855953 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.856037 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.856120 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.856202 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.856284 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.856380 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.856473 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.856558 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.856649 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.856733 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.856824 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.856916 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.857009 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.857153 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.857239 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.857321 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.857410 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.857502 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.857586 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.857743 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.857826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.857905 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.857985 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.857985 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.858154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:47:08.858245 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.858245 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.858396 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.858478 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.858569 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.858654 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.858739 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.858828 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.858921 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.859004 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.859094 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.859179 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.859267 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.859351 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.859446 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.859541 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.859632 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.859723 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.859812 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.859896 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.859896 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.860066 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.860156 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.860240 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.860330 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.861719 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.861850 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.861968 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.862060 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.862143 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.862143 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.862277 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.862365 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.862447 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.862526 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.862599 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.862671 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.862742 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.862826 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.862905 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.862983 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.863065 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.863142 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.863214 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.863293 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.863366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.863446 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.863525 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.863603 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.863675 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.863758 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.863832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.863832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.863971 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.864049 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.864120 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.864205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.864277 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.864354 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.864426 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.864497 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.864575 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.864648 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.864718 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.864787 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.864857 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.864926 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.865008 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.865080 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.865151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.865151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.865285 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.865829 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.865928 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.866010 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.866082 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.866152 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.866230 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.866303 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.866387 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.866461 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.866538 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.866609 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.866680 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.866763 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.866837 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.866908 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.866978 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.867054 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.867125 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.867240 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.867326 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.867406 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.867485 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.867485 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.867485 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.870887 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.870990 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.871065 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.871157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.871233 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.871309 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.871404 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.871487 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.871559 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.871653 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.871724 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.871882 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.871975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.872173 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.872262 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.872343 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.872423 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.872503 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.872577 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.872654 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.872734 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.872806 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.872943 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.873027 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.873702 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.873805 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.873881 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.874021 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.874096 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.874240 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.874327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.874400 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.874479 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.874551 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.874622 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.874701 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.874775 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.874844 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.874921 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.874993 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.875168 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.875253 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.875325 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.875402 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.875474 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.875545 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.875628 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.875708 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.875786 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.875865 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.876028 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.876118 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.876207 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.876287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.876412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.876499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.876572 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.876643 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.876725 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.876800 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.876878 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.876951 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.877021 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.877100 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.877179 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.877259 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.877330 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.877465 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.877555 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.877655 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.877747 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.877822 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.877899 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.878031 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.878560 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.878649 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.878723 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.878793 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.878870 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.878955 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.879034 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.879112 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.879184 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.879254 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.879330 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.879415 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.879488 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.879565 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.879651 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.879722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.879813 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.879895 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.880032 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.880120 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.880194 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.880279 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.880360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.880497 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.880585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.880658 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.880658 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.880867 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.880961 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.880961 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.880961 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.880961 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.881301 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.881375 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.881454 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.881534 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.881611 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.883528 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.884153 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.884153 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.884354 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.884919 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.885007 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.885096 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.885366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.885477 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.885567 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.885567 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.885734 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.885734 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.885891 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.885993 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.885993 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.885993 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.885993 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.885993 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.886378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.886471 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.886471 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.886615 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.886698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.886782 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.886862 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.886862 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.887031 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.887115 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.887208 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.887301 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.887401 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.887494 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.887494 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.887494 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.887494 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.887494 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.887875 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.887947 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.888018 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.888104 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.888188 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.888280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.888365 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.888455 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.888455 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.888607 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.888695 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.888781 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.888865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.888948 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.889039 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.889039 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.889211 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.889304 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.889390 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.889481 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.889567 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.889703 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.889794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.889879 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.889977 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.890070 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.890162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.890261 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.890353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.890353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.890495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.890578 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.890660 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.890743 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.890829 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.890919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.891012 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.891104 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.891201 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.891300 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.891388 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.891477 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.891563 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.891646 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.891748 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.891835 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.891915 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.892736 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.892836 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.892912 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.893000 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.893074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.893145 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.893214 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.893302 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.893435 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.893530 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.893647 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.893749 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.893844 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.893944 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.894044 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.894132 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.894216 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.894307 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.894393 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.894466 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.894556 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.894650 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.894650 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.894826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.894918 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.895010 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.895105 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.895191 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.895282 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.895375 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.895456 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.895528 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.895528 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.895671 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.895749 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.895827 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.895904 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.895995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.896068 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.896152 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.896669 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.896779 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.896779 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.896961 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.897057 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.897151 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.897251 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.897346 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.897432 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.897593 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.897593 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.897918 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.897918 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.898086 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.898172 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.898266 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.898266 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.898432 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.898524 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.898686 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.898787 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.898874 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.898954 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.899045 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.899159 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.899249 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.899249 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.899418 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.899718 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.899814 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.899908 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.900002 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.900103 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.900189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.900274 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.900346 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.900436 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.900521 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.900521 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.900521 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.900770 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.900909 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.901026 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.901147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.901262 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.901364 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.901459 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.901546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.901645 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.901748 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.901836 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.901929 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.902022 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.902169 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.902330 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.902505 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.902650 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.902788 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.903099 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.903241 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.903414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.903578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.903724 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.903896 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.904041 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.904217 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.904375 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.904555 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.904705 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.904855 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.905002 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.905146 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.905303 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.905478 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.905720 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.905878 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.905971 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.906265 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.906384 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.906473 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.906593 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.906759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.906905 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.907066 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.907228 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.907378 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.907558 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.907685 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.907880 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.907995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.908199 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.908300 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.908522 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.908626 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.908834 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.908927 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.909154 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.909248 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.909473 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.909595 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.909807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.909899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.910119 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.910219 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.910424 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.910528 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.910738 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.910855 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.911046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.911169 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.911358 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.911457 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.911668 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.911760 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.911973 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.912073 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.912280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.912370 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.912586 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.912689 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.912916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.913014 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.913220 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.913312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.913532 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.913622 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.913885 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.913988 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.914203 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.914311 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.914520 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.914613 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.914880 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.914990 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.915283 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.915623 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.915894 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.915998 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.916107 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.916341 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.916488 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.916643 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.916786 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.916942 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.917088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.917244 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.917388 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.917532 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.917715 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.917861 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.918018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.918170 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.918273 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.918361 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.918523 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.918661 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.918837 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.918977 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.919142 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.919287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.919455 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.919734 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.919838 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.920051 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.920146 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.920364 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.920457 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.920673 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.920779 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.921230 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.921337 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.921541 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.921672 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.921875 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.921970 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.922182 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.922275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.922496 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.922611 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.922799 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.922915 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.923116 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.923228 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.923422 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.923522 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.923728 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.923828 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.924066 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.924188 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.924340 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.924450 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.924650 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.924745 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.924954 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.925060 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.925278 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.925381 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.925589 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.925741 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.926015 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.926117 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.926256 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.926354 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.926575 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.926675 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.926832 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.926922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.927136 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.927329 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.927460 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.927651 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.927744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.927963 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.928064 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.928349 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.928452 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.928660 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.928766 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.928967 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.929073 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.929274 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.929373 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.929583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.929708 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.929917 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.930028 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.930226 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.930327 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.931259 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.931356 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.931658 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.931920 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.932236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.932398 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.932549 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.932844 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.932953 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.933208 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.933370 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.933478 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.933807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.934011 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.934122 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.934416 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.934498 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.934768 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.934866 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.935106 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.935200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.935422 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.935697 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.935799 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.936143 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.936237 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.936356 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.936488 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.936749 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.936913 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.937002 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.937335 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.937452 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.937587 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.937927 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.938031 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.938242 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.938526 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.938620 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.938839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.939030 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.939163 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.939366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.939478 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.939704 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.939793 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.940038 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.940190 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.940364 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.940486 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.940709 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.940807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.941015 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.941119 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.941332 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.941452 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.941681 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.941791 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.941975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.942074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.945978 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.946158 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.946771 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.947109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.947209 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.947303 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.947402 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.947497 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.947594 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.947679 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.947763 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.947847 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.947939 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.948025 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.948108 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.948191 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.948274 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.948357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.948449 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.948540 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.948631 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.948722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.948806 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.948897 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.948997 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.949094 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.949180 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.949262 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.949262 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.949262 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.949493 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.949583 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.949683 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.949787 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.949881 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.949966 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.950050 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.950140 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.950224 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.950333 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.950421 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.950513 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.950599 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.950683 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.951107 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.951220 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.951317 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.951409 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.951494 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.951586 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.951672 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.951768 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.951854 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.951937 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.952028 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.952112 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.952203 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.952297 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.952390 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.952475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.952566 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.952651 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.952744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.952836 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.953038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.953143 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.953342 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.953434 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.953668 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.953768 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.953998 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.954090 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.954307 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.954401 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.954614 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.954707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.954921 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.955021 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.955246 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.955338 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.955551 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.955654 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.955866 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.955967 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.956231 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.956345 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.956545 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.956688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.956904 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.957212 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.957304 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.957435 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.957597 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.957739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.957951 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.958082 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.958278 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.958415 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.958604 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.958700 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.958946 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.959043 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.959239 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.959350 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.959555 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.959670 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.959873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.960095 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.960268 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.960410 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.960559 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.960702 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.960850 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.960996 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.961174 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.961316 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.961468 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.961695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.961839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.962010 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.962407 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.962652 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.962780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.962989 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.963140 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.963329 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.963444 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.963722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.963828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.964043 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.964163 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.964360 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.964455 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.964676 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.964778 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.964993 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.965087 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.965312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.965418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.965625 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.965778 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.965964 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.966067 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.966284 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.966386 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.966596 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.966690 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.966927 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.967028 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.967269 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.967484 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.967587 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.967682 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.967846 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.967953 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.968163 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.968255 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.968475 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.968566 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.968783 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.968883 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.969112 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.969212 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.969424 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.969537 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.969768 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.969874 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.970087 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.970186 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.970393 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.970485 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.970703 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.970795 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.971021 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.971121 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.971337 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.971430 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.971650 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.971744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.971958 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.972049 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.972267 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.972367 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.972576 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.972677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.972910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.973001 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.973226 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.973361 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.973553 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.973706 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.973896 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.973990 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.974214 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.974323 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.974533 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.974632 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.974868 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.975056 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.975199 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.975375 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.975518 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.975712 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.975841 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.976043 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.976177 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.976371 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.976512 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.976718 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.976819 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.977039 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.977142 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.978121 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.978230 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.978388 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.978703 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.978837 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.979021 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.979161 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.979335 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.979483 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.979644 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.979799 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.979975 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.980117 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.980292 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.980415 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.980599 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.980748 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.980923 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.981065 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.981242 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.981398 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.981740 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.981858 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.982055 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.982151 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.982367 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.982460 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.982677 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.982802 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.983026 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.983130 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.983344 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.983480 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.983685 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.983822 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.984011 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.984138 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.984339 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.984455 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.984647 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.984760 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.984967 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.985079 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.985284 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.985395 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.985593 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.985732 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.985930 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.986034 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.986249 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.986366 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.986543 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.986633 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.986858 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.986963 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.987171 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.987303 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.987477 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.987581 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.987789 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.987900 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.988213 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.988336 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.988426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.988511 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.988714 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.988815 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.989030 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.989268 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.989370 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.989597 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.989723 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.989939 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.990032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.990248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.990349 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.990560 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.990642 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.991418 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.991546 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.991546 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.991707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.991792 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.992006 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.992116 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.992212 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.992299 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.992445 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.992534 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.992630 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.992716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.992809 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.993047 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.993842 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.994054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.994374 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.994484 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.994699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.994802 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.995024 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.995135 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.995359 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.995472 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.995679 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.995783 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.995997 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.996093 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.996352 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.996462 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.996671 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.996766 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.996985 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.997228 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.997333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.997572 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.997723 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.997929 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.998040 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.998249 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.998357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.998537 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.998641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.998850 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.998945 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.999166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.999275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.999478 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.999573 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.999789 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:08.999890 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.000102 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.000208 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.000421 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.000585 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.000742 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.000890 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.001052 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.001202 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.001352 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.001492 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.001630 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.001748 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.001967 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.002063 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.002285 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.002384 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.002605 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.002828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.002977 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.003143 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.003237 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.003478 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.003570 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.003810 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.003935 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.004346 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.004466 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.004466 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.004639 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.004736 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.004830 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.005061 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.005176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.005367 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.005472 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.005692 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.005798 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.006006 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.006099 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.006323 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.006435 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.006626 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.006723 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.007004 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.007110 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.007268 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.007397 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.007574 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.007689 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.007896 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.008005 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.008197 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.008322 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.008767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.009041 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.009137 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.009397 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.009717 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.009831 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.010044 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.010139 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.010373 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.010466 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.010702 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.010800 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.011018 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.011114 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.011328 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.011431 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.011646 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.011746 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.011957 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.012097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.012268 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.012370 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.012588 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.012697 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.012904 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.012998 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.013214 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.013318 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.013522 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.013617 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.013859 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.014048 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.014169 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.014370 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.014476 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.014566 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.014774 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.014876 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.015079 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.015182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.015405 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.015507 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.015715 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.015816 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.016022 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.016147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.016330 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.016433 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.016637 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.016730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.016940 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.017035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.017251 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.017408 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.017577 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.017754 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.017916 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.018062 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.018212 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.018361 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.018501 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.018765 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.018937 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.019101 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.019236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.019326 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.019420 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.019506 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.019642 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.019745 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.019946 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.020039 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.020253 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.020359 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.020558 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.020653 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.020864 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.020958 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.021194 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.021296 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.021517 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.021611 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.021855 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.021950 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.022181 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.022289 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.022493 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.022589 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.022806 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.022908 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.023116 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.023230 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.023442 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.023537 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.023770 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.024006 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.024215 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.024661 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.024977 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.025247 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.025399 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.025655 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.025869 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.025999 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.026313 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.026465 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.026631 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.026942 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.027050 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.027273 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.027517 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.027630 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.027839 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.028038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.028180 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.028312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.028446 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.028546 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.028795 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.028952 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.029106 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.029395 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.029489 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.029751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.029865 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.030063 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.030158 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.030375 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.030494 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.030687 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.030829 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.031000 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.031312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.031411 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.031632 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.031978 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.032078 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.032303 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.032562 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.032662 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.032910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.033010 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.033228 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.033321 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.033541 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.033655 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.033878 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.033973 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.034195 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.034373 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.034630 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.034784 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.034938 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.035092 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.035235 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.035398 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.035550 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.035695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.035834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.035993 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.036134 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.036271 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.036465 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.036626 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.036775 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.036880 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.037124 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.037227 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.037454 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.037555 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.037798 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.037894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.038123 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.038236 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.038437 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.038580 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.038703 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 15:47:09.038811 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.039057 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.039385 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.039723 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.041117 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.041455 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.041793 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.042105 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.042415 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.042729 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.043051 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.043364 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.043669 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.043974 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.044563 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.044563 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.044883 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.045187 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.045490 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.045824 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.046408 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.046677 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.046981 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.047284 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.047587 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.047889 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.048200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.048502 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.048807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.049123 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.049410 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.049730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.050064 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.050417 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.050712 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.051032 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.051346 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.051668 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.052320 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.052320 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.052612 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.052934 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.053246 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.053582 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.053922 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.054235 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.054565 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.054856 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.055241 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.055533 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.057078 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.057394 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.057736 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.058071 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.058397 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.058731 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.059054 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.059373 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.059706 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.060019 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.060332 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.060649 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.060962 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.061272 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.061587 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.061928 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.062256 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.062581 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.062893 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.063221 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.063547 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.063900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.064215 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.064559 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.064889 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.065205 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.065518 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.065846 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:47:09.066089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 15:47:09.102215 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO dbcounter [None req-24ea82f1-e44c-490e-a5dd-ea3b7d17415a None None] Registered counter for database nova_api Jun 27 15:47:09.126390 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_db.sqlalchemy.engines [None req-24ea82f1-e44c-490e-a5dd-ea3b7d17415a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:47:09.131739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writer thread running {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:47:09.134696 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO dbcounter [None req-1ca8a972-e582-4111-8cd3-c0bb4ebe26f8 None None] Registered counter for database nova_api Jun 27 15:47:09.154575 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_db.sqlalchemy.engines [None req-1ca8a972-e582-4111-8cd3-c0bb4ebe26f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:47:09.161402 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writer thread running {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:47:09.190667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.context [None req-24ea82f1-e44c-490e-a5dd-ea3b7d17415a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),36cad6b8-e240-4e63-a1f3-ff7ac63edcb9(cell1) {{(pid=129473) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 15:47:09.194866 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-24ea82f1-e44c-490e-a5dd-ea3b7d17415a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:47:09.197047 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-24ea82f1-e44c-490e-a5dd-ea3b7d17415a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:47:09.198067 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-24ea82f1-e44c-490e-a5dd-ea3b7d17415a None None] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:47:09.200093 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-24ea82f1-e44c-490e-a5dd-ea3b7d17415a None None] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:47:09.202186 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO dbcounter [None req-24ea82f1-e44c-490e-a5dd-ea3b7d17415a None None] Registered counter for database nova_cell0 Jun 27 15:47:09.206338 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO dbcounter [None req-24ea82f1-e44c-490e-a5dd-ea3b7d17415a None None] Registered counter for database nova_cell1 Jun 27 15:47:09.214916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_db.sqlalchemy.engines [None req-24ea82f1-e44c-490e-a5dd-ea3b7d17415a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:47:09.217347 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_db.sqlalchemy.engines [None req-24ea82f1-e44c-490e-a5dd-ea3b7d17415a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:47:09.220496 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.context [None req-1ca8a972-e582-4111-8cd3-c0bb4ebe26f8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),36cad6b8-e240-4e63-a1f3-ff7ac63edcb9(cell1) {{(pid=129472) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 15:47:09.223641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writer thread running {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:47:09.224959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writer thread running {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:47:09.225077 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1ca8a972-e582-4111-8cd3-c0bb4ebe26f8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:47:09.226658 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1ca8a972-e582-4111-8cd3-c0bb4ebe26f8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:47:09.227697 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1ca8a972-e582-4111-8cd3-c0bb4ebe26f8 None None] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:47:09.229775 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1ca8a972-e582-4111-8cd3-c0bb4ebe26f8 None None] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:47:09.232167 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO dbcounter [None req-1ca8a972-e582-4111-8cd3-c0bb4ebe26f8 None None] Registered counter for database nova_cell0 Jun 27 15:47:09.236971 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO dbcounter [None req-1ca8a972-e582-4111-8cd3-c0bb4ebe26f8 None None] Registered counter for database nova_cell1 Jun 27 15:47:09.244762 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_db.sqlalchemy.engines [None req-1ca8a972-e582-4111-8cd3-c0bb4ebe26f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:47:09.247255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_db.sqlalchemy.engines [None req-1ca8a972-e582-4111-8cd3-c0bb4ebe26f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:47:09.252887 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writer thread running {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:47:09.254558 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writer thread running {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:47:09.381595 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO dbcounter [None req-24ea82f1-e44c-490e-a5dd-ea3b7d17415a None None] Registered counter for database nova_cell0 Jun 27 15:47:09.388735 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_db.sqlalchemy.engines [None req-24ea82f1-e44c-490e-a5dd-ea3b7d17415a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:47:09.393325 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writer thread running {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:47:09.411848 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO dbcounter [None req-1ca8a972-e582-4111-8cd3-c0bb4ebe26f8 None None] Registered counter for database nova_cell0 Jun 27 15:47:09.422041 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_db.sqlalchemy.engines [None req-1ca8a972-e582-4111-8cd3-c0bb4ebe26f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:47:09.431177 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writer thread running {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:47:09.735935 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: WARNING keystonemiddleware.auth_token [None req-24ea82f1-e44c-490e-a5dd-ea3b7d17415a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 15:47:09.744451 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: WARNING keystonemiddleware.auth_token [None req-24ea82f1-e44c-490e-a5dd-ea3b7d17415a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 15:47:09.762638 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: WARNING keystonemiddleware.auth_token [None req-1ca8a972-e582-4111-8cd3-c0bb4ebe26f8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 15:47:09.770401 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: WARNING keystonemiddleware.auth_token [None req-1ca8a972-e582-4111-8cd3-c0bb4ebe26f8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 15:47:10.111456 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: WARNING keystonemiddleware.auth_token [None req-24ea82f1-e44c-490e-a5dd-ea3b7d17415a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 15:47:10.117551 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: WARNING keystonemiddleware.auth_token [None req-24ea82f1-e44c-490e-a5dd-ea3b7d17415a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 15:47:10.124307 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555d6e6ec9c0 pid: 129473 (default app) Jun 27 15:47:10.127201 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: WARNING keystonemiddleware.auth_token [None req-1ca8a972-e582-4111-8cd3-c0bb4ebe26f8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 15:47:10.133437 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: WARNING keystonemiddleware.auth_token [None req-1ca8a972-e582-4111-8cd3-c0bb4ebe26f8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 15:47:10.139493 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555d6e6ec9c0 pid: 129472 (default app) Jun 27 15:47:52.080876 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=3 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:47:52.087784 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=3 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:47:52.089205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=3 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:47:52.090635 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=3 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:47:54.208568 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-aa15a87c-3032-48ee-98e4-fbc323f927bc tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Action: 'create', calling method: .version_select at 0x7fe14842e790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-71588958"}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:47:56.345373 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-aa15a87c-3032-48ee-98e4-fbc323f927bc tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 4.287521 Jun 27 15:47:56.348192 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1154 bytes} [Mon Jun 27 15:47:52 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 4292 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 27 15:47:56.362111 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-9589cca1-c2b6-41a3-b522-3620990ff51a tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Calling method '.version_select at 0x7fe1482fb5e0>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:47:56.599592 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-9589cca1-c2b6-41a3-b522-3620990ff51a tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b56d7a6a-f887-45e0-adaa-85b66c243ccb" status: 200 len: 344 microversion: 2.1 time: 0.242061 Jun 27 15:47:56.601429 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 2/2] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 27 15:47:56 2022] GET /compute/v2.1/os-volumes/b56d7a6a-f887-45e0-adaa-85b66c243ccb => generated 344 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:47:56.615549 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c8487c81-b3de-413e-91c5-bed3e509f995 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Action: 'create', calling method: .version_select at 0x7fe1482fb8b0>, body: {"snapshot": {"volume_id": "b56d7a6a-f887-45e0-adaa-85b66c243ccb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1867442811"}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:47:56.709593 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3a3a0be5-e105-434a-b9a2-2d5b9ea89d4b tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] Calling method '.version_select at 0x7fe1484e9280>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:47:56.791822 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=3 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:47:56.792614 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=3 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:47:56.793406 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=3 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:47:56.805910 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=3 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:47:57.511999 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c8487c81-b3de-413e-91c5-bed3e509f995 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.902785 Jun 27 15:47:57.514373 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 3/3] 10.222.0.20 () {60 vars in 1161 bytes} [Mon Jun 27 15:47:56 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:47:57.528655 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-8350dc41-5f18-4912-8083-ce821ab793ac tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Calling method '.version_select at 0x7fe148294280>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:47:57.862913 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-8350dc41-5f18-4912-8083-ce821ab793ac tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d6269321-1b15-4b12-9eb5-12f092542be6" status: 200 len: 287 microversion: 2.1 time: 0.343600 Jun 27 15:47:57.864386 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 4/4] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jun 27 15:47:57 2022] GET /compute/v2.1/os-snapshots/d6269321-1b15-4b12-9eb5-12f092542be6 => generated 287 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:47:57.874118 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-bbf535b6-fa0e-4432-af47-0aa57094404a tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Calling method '.version_select at 0x7fe148294940>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:47:58.030408 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3a3a0be5-e105-434a-b9a2-2d5b9ea89d4b tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/ef035b61-3c90-4534-ad7e-b86497edd43b" status: 200 len: 351 microversion: 2.1 time: 1.821684 Jun 27 15:47:58.032503 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 1/5] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 27 15:47:56 2022] GET /compute/v2.1/os-volumes/ef035b61-3c90-4534-ad7e-b86497edd43b => generated 351 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:47:58.405995 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-bbf535b6-fa0e-4432-af47-0aa57094404a tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.535604 Jun 27 15:47:58.406905 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 5/6] 10.222.0.20 () {58 vars in 1139 bytes} [Mon Jun 27 15:47:57 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:47:58.419667 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d98343c1-f6da-4241-9144-d42d1d612dc9 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Calling method '.version_select at 0x7fe14833d550>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:47:58.658986 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d98343c1-f6da-4241-9144-d42d1d612dc9 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d6269321-1b15-4b12-9eb5-12f092542be6" status: 200 len: 287 microversion: 2.1 time: 0.244332 Jun 27 15:47:58.665371 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 2/7] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jun 27 15:47:58 2022] GET /compute/v2.1/os-snapshots/d6269321-1b15-4b12-9eb5-12f092542be6 => generated 287 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:47:59.199789 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a9d6183a-ceaa-41d3-a59c-5bafdd4355d7 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-314101480", "imageRef": "11f9be98-90d6-4c67-8d66-0b944f5a2a2b", "flavorRef": "452", "networks": [{"uuid": "fc0879b6-378d-415c-847a-7aee1f0c60a0"}]}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:47:59.514669 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.network.neutron [None req-a9d6183a-ceaa-41d3-a59c-5bafdd4355d7 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] validate_networks() for [('fc0879b6-378d-415c-847a-7aee1f0c60a0', None, None, None, None, None)] {{(pid=129473) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:47:59.671592 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ac4df1b2-bfdb-4144-b758-cb6965508578 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Calling method '.version_select at 0x7fe14833d4c0>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:47:59.739854 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ac4df1b2-bfdb-4144-b758-cb6965508578 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d6269321-1b15-4b12-9eb5-12f092542be6" status: 200 len: 287 microversion: 2.1 time: 0.072693 Jun 27 15:47:59.741089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 3/8] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jun 27 15:47:59 2022] GET /compute/v2.1/os-snapshots/d6269321-1b15-4b12-9eb5-12f092542be6 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:48:00.753452 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-b25c6db8-e1bc-46bb-bbfe-879bec95bb7e tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Calling method '.version_select at 0x7fe14833ddc0>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:00.879527 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-b25c6db8-e1bc-46bb-bbfe-879bec95bb7e tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d6269321-1b15-4b12-9eb5-12f092542be6" status: 200 len: 287 microversion: 2.1 time: 0.130873 Jun 27 15:48:00.880523 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 4/9] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jun 27 15:48:00 2022] GET /compute/v2.1/os-snapshots/d6269321-1b15-4b12-9eb5-12f092542be6 => generated 287 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:48:01.445817 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-a9d6183a-ceaa-41d3-a59c-5bafdd4355d7 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Flavor limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:48:01.446334 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-a9d6183a-ceaa-41d3-a59c-5bafdd4355d7 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Image limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:48:01.446776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-a9d6183a-ceaa-41d3-a59c-5bafdd4355d7 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Flavor pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:48:01.447192 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-a9d6183a-ceaa-41d3-a59c-5bafdd4355d7 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Image pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:48:01.447960 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-a9d6183a-ceaa-41d3-a59c-5bafdd4355d7 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:48:01.498006 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a9d6183a-ceaa-41d3-a59c-5bafdd4355d7 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:01.498920 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a9d6183a-ceaa-41d3-a59c-5bafdd4355d7 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:01.500034 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a9d6183a-ceaa-41d3-a59c-5bafdd4355d7 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:01.500627 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a9d6183a-ceaa-41d3-a59c-5bafdd4355d7 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:01.640688 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-a9d6183a-ceaa-41d3-a59c-5bafdd4355d7 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Getting quotas for project 2a805612e76c4f5e9052aa4a8ead24f1. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:48:01.655444 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-a9d6183a-ceaa-41d3-a59c-5bafdd4355d7 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Getting quotas for user 3520bd4387a140f88558d5f6fe55986e and project 2a805612e76c4f5e9052aa4a8ead24f1. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:48:01.665734 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d858b0b6-0d43-4e27-bb0a-ad7906764f9d tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] Calling method '.version_select at 0x7fe1483074c0>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:01.717203 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a9d6183a-ceaa-41d3-a59c-5bafdd4355d7 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Going to run 1 instances... {{(pid=129473) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:48:01.728354 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a9d6183a-ceaa-41d3-a59c-5bafdd4355d7 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11f9be98-90d6-4c67-8d66-0b944f5a2a2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:48:01.812418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d858b0b6-0d43-4e27-bb0a-ad7906764f9d tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3ca8c25e-f2e6-40ec-aadc-cc6636c15f09" status: 200 len: 351 microversion: 2.1 time: 0.152614 Jun 27 15:48:01.814035 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 5/10] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 27 15:48:01 2022] GET /compute/v2.1/os-volumes/3ca8c25e-f2e6-40ec-aadc-cc6636c15f09 => generated 351 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:48:01.892527 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-0e4f9879-0ca3-4bec-a711-1b3e872e1a95 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Calling method '.version_select at 0x7fe14833dca0>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:01.925950 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a9d6183a-ceaa-41d3-a59c-5bafdd4355d7 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.859329 Jun 27 15:48:01.934182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 6/11] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 15:47:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:48:01.947602 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f585eb1a-2964-4c29-acd3-53f05af8f409 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:01.949976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f585eb1a-2964-4c29-acd3-53f05af8f409 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:01.979654 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-0e4f9879-0ca3-4bec-a711-1b3e872e1a95 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d6269321-1b15-4b12-9eb5-12f092542be6" status: 200 len: 288 microversion: 2.1 time: 0.090907 Jun 27 15:48:01.986358 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jun 27 15:48:01 2022] GET /compute/v2.1/os-snapshots/d6269321-1b15-4b12-9eb5-12f092542be6 => generated 288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:48:01.991435 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ebb7fba2-5ec6-4a62-b508-59f2d3af98ef tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Calling method '.version_select at 0x7fe14833d700>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:02.200444 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ebb7fba2-5ec6-4a62-b508-59f2d3af98ef tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/d6269321-1b15-4b12-9eb5-12f092542be6" status: 202 len: 0 microversion: 2.1 time: 0.212804 Jun 27 15:48:02.200903 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1253 bytes} [Mon Jun 27 15:48:01 2022] DELETE /compute/v2.1/os-snapshots/d6269321-1b15-4b12-9eb5-12f092542be6 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:48:02.216621 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-466f251c-eec1-435e-8112-3262e8be6323 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Calling method '.version_select at 0x7fe148307670>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:02.248041 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f585eb1a-2964-4c29-acd3-53f05af8f409 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:02.270816 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f585eb1a-2964-4c29-acd3-53f05af8f409 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1214 microversion: 2.1 time: 0.335231 Jun 27 15:48:02.277693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 7/14] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:01 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1214 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:02.385372 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-466f251c-eec1-435e-8112-3262e8be6323 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d6269321-1b15-4b12-9eb5-12f092542be6" status: 200 len: 287 microversion: 2.1 time: 0.178875 Jun 27 15:48:02.385961 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 8/15] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jun 27 15:48:02 2022] GET /compute/v2.1/os-snapshots/d6269321-1b15-4b12-9eb5-12f092542be6 => generated 287 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:48:03.306647 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e5b62a79-be1c-4ac5-bc4a-7e2281ea05ca tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:03.307278 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e5b62a79-be1c-4ac5-bc4a-7e2281ea05ca tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:03.397517 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-014ad311-3815-40ab-832e-196d821ffa68 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Calling method '.version_select at 0x7fe14833d4c0>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:03.475306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-014ad311-3815-40ab-832e-196d821ffa68 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] HTTP exception thrown: Snapshot d6269321-1b15-4b12-9eb5-12f092542be6 could not be found. Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-014ad311-3815-40ab-832e-196d821ffa68 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Request method failure captured: Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/os-snapshots/d6269321-1b15-4b12-9eb5-12f092542be6 HTTP/1.1 Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudEnQmpAymQrX9X_njuCWdQ_0qDcwmYuzbUhGAnJCpC7Tv95f089EQU-9LW9qcZDJlyDOBqvVbhcMcB92vWo22YZOaUrREK9xXo_X0L2ENGYxD2SAU5VdOJ_1g8bwgF_E0uCUoNdQQpgcAFN1vQOXlUa3ud_u6mkQ3pYV7E1v22xSdA Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 4b12bd7199c94e6392710d44c8b8c24e Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-299446724 Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:48:03.480716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:48:03.482234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b12bd7199c94e6392710d44c8b8c24e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b12bd7199c94e6392710d44c8b8c24e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b12bd7199c94e6392710d44c8b8c24e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b12bd7199c94e6392710d44c8b8c24e", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:48:03.482234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-VolumesSnapshotsTestJSON-299446724 Jun 27 15:48:03.482234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 4b12bd7199c94e6392710d44c8b8c24e Jun 27 15:48:03.482234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-299446724 Jun 27 15:48:03.482234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-VolumesSnapshotsTestJSON-299446724-project Jun 27 15:48:03.482234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:48:03.482234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:48:03.482234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: 61c7ee6276174c5f88e86810f632e690 Jun 27 15:48:03.482234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-VolumesSnapshotsTestJSON-299446724-project Jun 27 15:48:03.482234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: Jun 27 15:48:03.482234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Snapshot d6269321-1b15-4b12-9eb5-12f092542be6 could not be found. Jun 27 15:48:03.482234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': 'd6269321-1b15-4b12-9eb5-12f092542be6'} Jun 27 15:48:03.482234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:48:03.483149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:48:03.483149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 27 15:48:03.483149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 27 15:48:03.483149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 27 15:48:03.483149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 27 15:48:03.483149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 27 15:48:03.483149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 27 15:48:03.483149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:48:03.483149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:48:03.483149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:48:03.483149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:48:03.483149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:48:03.483149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:48:03.483149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:48:03.483149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:48:03.483149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d6269321-1b15-4b12-9eb5-12f092542be6 could not be found. (HTTP 404) (Request-ID: req-b4838292-3a1e-4632-a0cc-5fd1748b91c2) Jun 27 15:48:03.483149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:03.483149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:48:03.484200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:03.484200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:48:03.484200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 27 15:48:03.484200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 27 15:48:03.484200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:48:03.484200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:48:03.484200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 27 15:48:03.484200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 27 15:48:03.484200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:48:03.484200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:48:03.484200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 27 15:48:03.484200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 27 15:48:03.484200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 27 15:48:03.484200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 27 15:48:03.484200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 27 15:48:03.484200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 27 15:48:03.484200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:48:03.484200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:48:03.484200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d6269321-1b15-4b12-9eb5-12f092542be6 could not be found. Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 27 15:48:03.485255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:48:03.487639 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d6269321-1b15-4b12-9eb5-12f092542be6 could not be found. Jun 27 15:48:03.487639 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:03.487639 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:48:03.487639 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:03.487639 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:48:03.487639 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:48:03.487639 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:48:03.487639 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:48:03.487639 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:48:03.487639 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d6269321-1b15-4b12-9eb5-12f092542be6 could not be found. Jun 27 15:48:03.487639 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:03.490172 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-014ad311-3815-40ab-832e-196d821ffa68 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Returning 404 to user: Snapshot d6269321-1b15-4b12-9eb5-12f092542be6 could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:48:03.494484 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-014ad311-3815-40ab-832e-196d821ffa68 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d6269321-1b15-4b12-9eb5-12f092542be6" status: 404 len: 111 microversion: 2.1 time: 0.101971 Jun 27 15:48:03.495543 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 9/16] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jun 27 15:48:03 2022] GET /compute/v2.1/os-snapshots/d6269321-1b15-4b12-9eb5-12f092542be6 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:48:03.517119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a88e81bd-3462-4e0c-9d56-00d384efec47 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Calling method '.version_select at 0x7fe148c5eb80>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:03.657657 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-a88e81bd-3462-4e0c-9d56-00d384efec47 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/b56d7a6a-f887-45e0-adaa-85b66c243ccb" status: 202 len: 0 microversion: 2.1 time: 0.154966 Jun 27 15:48:03.658447 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 10/17] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 27 15:48:03 2022] DELETE /compute/v2.1/os-volumes/b56d7a6a-f887-45e0-adaa-85b66c243ccb => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:48:03.667586 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-e6927599-3a48-4b97-91c1-8f1c5c39f77d tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Calling method '.version_select at 0x7fe14833d790>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:03.701833 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e5b62a79-be1c-4ac5-bc4a-7e2281ea05ca tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:03.717958 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e5b62a79-be1c-4ac5-bc4a-7e2281ea05ca tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1214 microversion: 2.1 time: 0.419297 Jun 27 15:48:03.732192 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 8/18] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:03 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1214 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:03.851876 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-6ed4bebb-76d0-493a-a417-dfcc3ce00ec9 tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] Calling method '.version_select at 0x7fe1479d0700>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:04.012502 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-e6927599-3a48-4b97-91c1-8f1c5c39f77d tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b56d7a6a-f887-45e0-adaa-85b66c243ccb" status: 200 len: 343 microversion: 2.1 time: 0.349882 Jun 27 15:48:04.014001 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 11/19] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 27 15:48:03 2022] GET /compute/v2.1/os-volumes/b56d7a6a-f887-45e0-adaa-85b66c243ccb => generated 343 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:48:04.152745 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-6ed4bebb-76d0-493a-a417-dfcc3ce00ec9 tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8ece6fbf-95ea-434e-9a87-2cd6f19dc879" status: 200 len: 350 microversion: 2.1 time: 0.314533 Jun 27 15:48:04.153816 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 9/20] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 27 15:48:03 2022] GET /compute/v2.1/os-volumes/8ece6fbf-95ea-434e-9a87-2cd6f19dc879 => generated 350 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:48:04.167220 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-28113677-27ee-4c70-8022-7d28587992be tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] Calling method '.version_select at 0x7fe14830b430>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:04.399317 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-28113677-27ee-4c70-8022-7d28587992be tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.238038 Jun 27 15:48:04.400196 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 12/21] 10.222.0.20 () {58 vars in 1133 bytes} [Mon Jun 27 15:48:04 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:04.415594 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3d853298-66e3-46f6-a084-0bec2ea220d7 tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] Calling method '.version_select at 0x7fe1479d09d0>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:04.665626 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3d853298-66e3-46f6-a084-0bec2ea220d7 tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.256665 Jun 27 15:48:04.669749 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 10/22] 10.222.0.20 () {58 vars in 1148 bytes} [Mon Jun 27 15:48:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:48:04.684292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-5c7ba6a7-26aa-48ff-9fca-89da01944c92 tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] Calling method '.version_select at 0x7fe14833d670>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:04.736205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c8e01455-6288-40ec-b9cf-9963a2830465 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:04.736916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c8e01455-6288-40ec-b9cf-9963a2830465 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:04.752729 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c8e01455-6288-40ec-b9cf-9963a2830465 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:04.755253 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c8e01455-6288-40ec-b9cf-9963a2830465 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:04.757819 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c8e01455-6288-40ec-b9cf-9963a2830465 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:04.758586 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c8e01455-6288-40ec-b9cf-9963a2830465 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:05.037778 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-5c7ba6a7-26aa-48ff-9fca-89da01944c92 tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.358806 Jun 27 15:48:05.040231 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 13/23] 10.222.0.20 () {58 vars in 1133 bytes} [Mon Jun 27 15:48:04 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:05.061368 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3b3990bf-e096-43b5-ae8e-fdd3031a6659 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Calling method '.version_select at 0x7fe14830ba60>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:05.191467 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3b3990bf-e096-43b5-ae8e-fdd3031a6659 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b56d7a6a-f887-45e0-adaa-85b66c243ccb" status: 200 len: 343 microversion: 2.1 time: 0.148994 Jun 27 15:48:05.193426 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 14/24] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 27 15:48:05 2022] GET /compute/v2.1/os-volumes/b56d7a6a-f887-45e0-adaa-85b66c243ccb => generated 343 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:48:05.219094 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-56785096-db12-48e2-83c9-2dcd7a0d987e tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] Calling method '.version_select at 0x7fe14830b310>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:05.245049 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-c8e01455-6288-40ec-b9cf-9963a2830465 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:05.278203 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c8e01455-6288-40ec-b9cf-9963a2830465 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1218 microversion: 2.1 time: 0.540430 Jun 27 15:48:05.279417 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 11/25] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:04 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1218 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:48:05.321352 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-56785096-db12-48e2-83c9-2dcd7a0d987e tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.126029 Jun 27 15:48:05.328445 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 15/26] 10.222.0.20 () {58 vars in 1166 bytes} [Mon Jun 27 15:48:05 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:48:05.335170 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-80219d61-16c8-40cf-903e-28bd6eade7a6 tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] Calling method '.version_select at 0x7fe14713b9d0>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:05.562441 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-80219d61-16c8-40cf-903e-28bd6eade7a6 tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.232173 Jun 27 15:48:05.563821 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 12/27] 10.222.0.20 () {58 vars in 1169 bytes} [Mon Jun 27 15:48:05 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:48:05.576927 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-950319f6-285e-4468-b311-2ec38f5c5db7 tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] Calling method '.version_select at 0x7fe14830b040>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:05.782874 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-950319f6-285e-4468-b311-2ec38f5c5db7 tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.210057 Jun 27 15:48:05.783963 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 16/28] 10.222.0.20 () {58 vars in 1154 bytes} [Mon Jun 27 15:48:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:05.796837 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3dc3face-6fbe-4d27-bb67-b1737bb7b367 tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] Calling method '.version_select at 0x7fe14714aa60>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:06.153991 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3dc3face-6fbe-4d27-bb67-b1737bb7b367 tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.362583 Jun 27 15:48:06.155027 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 13/29] 10.222.0.20 () {58 vars in 1187 bytes} [Mon Jun 27 15:48:05 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:48:06.182389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-44538921-9055-4a69-baed-f2e04283c2b6 tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] Calling method '.version_select at 0x7fe148c5d940>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:06.460638 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-816144df-e8a7-4c13-837a-829d0d409417 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Action: 'create', calling method: .version_select at 0x7fe148c5eaf0>, body: {"keypair": {"name": "tempest-keypair-1474949121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2S+ysCTB7yYdYxpKoqf578kxjbiN5rUsQzNa+Uk+6p+c8Dsk4Palz9VePXgwKOxDXGH3PpNYSkmwodIbqbl/Ll5xQ63PI8IdMJncgsBbSJlodfAWIFv1hU9e329RNhYw=="}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:48:06.514902 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-44538921-9055-4a69-baed-f2e04283c2b6 tempest-VolumesTestJSON-572886802 tempest-VolumesTestJSON-572886802-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.344997 Jun 27 15:48:06.517924 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 14/30] 10.222.0.20 () {58 vars in 1154 bytes} [Mon Jun 27 15:48:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:06.541023 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-89854bb7-b76c-4eb8-93b8-05f2d431dd8a tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Calling method '.version_select at 0x7fe14714a280>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:06.640954 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-816144df-e8a7-4c13-837a-829d0d409417 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Getting quotas for project 5b5846565bf74c5cac3ff5c3168cfd48. Resources: {'key_pairs'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:48:06.659754 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-816144df-e8a7-4c13-837a-829d0d409417 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Getting quotas for user d35c652539f443d4895b5f81461833ba and project 5b5846565bf74c5cac3ff5c3168cfd48. Resources: {'key_pairs'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:48:06.879384 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-89854bb7-b76c-4eb8-93b8-05f2d431dd8a tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] HTTP exception thrown: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-89854bb7-b76c-4eb8-93b8-05f2d431dd8a tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Request method failure captured: Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: GET /compute/v2.1/os-volumes/b56d7a6a-f887-45e0-adaa-85b66c243ccb HTTP/1.1 Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudEnQmpAymQrX9X_njuCWdQ_0qDcwmYuzbUhGAnJCpC7Tv95f089EQU-9LW9qcZDJlyDOBqvVbhcMcB92vWo22YZOaUrREK9xXo_X0L2ENGYxD2SAU5VdOJ_1g8bwgF_E0uCUoNdQQpgcAFN1vQOXlUa3ud_u6mkQ3pYV7E1v22xSdA Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 4b12bd7199c94e6392710d44c8b8c24e Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-299446724 Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:48:06.888542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:48:06.890196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b12bd7199c94e6392710d44c8b8c24e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b12bd7199c94e6392710d44c8b8c24e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b12bd7199c94e6392710d44c8b8c24e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b12bd7199c94e6392710d44c8b8c24e", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:48:06.890196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-VolumesSnapshotsTestJSON-299446724 Jun 27 15:48:06.890196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 4b12bd7199c94e6392710d44c8b8c24e Jun 27 15:48:06.890196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-299446724 Jun 27 15:48:06.890196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-VolumesSnapshotsTestJSON-299446724-project Jun 27 15:48:06.890196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:48:06.890196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:48:06.890196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 61c7ee6276174c5f88e86810f632e690 Jun 27 15:48:06.890196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-VolumesSnapshotsTestJSON-299446724-project Jun 27 15:48:06.890196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: Jun 27 15:48:06.890196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. Jun 27 15:48:06.890196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': 'b56d7a6a-f887-45e0-adaa-85b66c243ccb'} Jun 27 15:48:06.890196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:48:06.891499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:48:06.891499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:48:06.891499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:48:06.891499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:48:06.891499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:48:06.891499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:48:06.891499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:48:06.891499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:48:06.891499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:48:06.891499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:48:06.891499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:48:06.891499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:48:06.891499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:48:06.891499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:48:06.891499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:48:06.891499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. (HTTP 404) (Request-ID: req-d25968c4-27a8-4b39-8e93-2ce2847e735b) Jun 27 15:48:06.891499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:48:06.891499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:48:06.891499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:48:06.892722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:48:06.892722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 15:48:06.892722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 15:48:06.892722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:48:06.892722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:48:06.892722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:48:06.892722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:48:06.892722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:48:06.892722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:48:06.892722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:48:06.892722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:48:06.892722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:48:06.892722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:48:06.892722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:48:06.892722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:48:06.892722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:48:06.892722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:48:06.892722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:48:06.892722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:48:06.894196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:48:06.894196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:48:06.894196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:48:06.894196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:48:06.894196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. Jun 27 15:48:06.894196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:48:06.894196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:48:06.894196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:48:06.894196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:48:06.894196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:48:06.894196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:48:06.894196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:48:06.894196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:48:06.894196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:48:06.894196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:48:06.894196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:48:06.894196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:48:06.894196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 15:48:06.894196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:48:06.895682 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. Jun 27 15:48:06.895682 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:48:06.895682 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:48:06.895682 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:48:06.895682 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:48:06.895682 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:48:06.895682 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:48:06.895682 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:48:06.895682 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:48:06.895682 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. Jun 27 15:48:06.895682 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:48:06.901162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-89854bb7-b76c-4eb8-93b8-05f2d431dd8a tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Returning 404 to user: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:48:06.902244 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-89854bb7-b76c-4eb8-93b8-05f2d431dd8a tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b56d7a6a-f887-45e0-adaa-85b66c243ccb" status: 404 len: 109 microversion: 2.1 time: 0.381901 Jun 27 15:48:06.905598 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 15/31] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 27 15:48:06 2022] GET /compute/v2.1/os-volumes/b56d7a6a-f887-45e0-adaa-85b66c243ccb => generated 109 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:48:06.920174 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-816144df-e8a7-4c13-837a-829d0d409417 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.939192 Jun 27 15:48:06.922576 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-42aaa966-7fe9-4c66-a4ed-90ab5e756b68 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:06.923348 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-42aaa966-7fe9-4c66-a4ed-90ab5e756b68 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:06.930232 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 17/32] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 27 15:48:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:48:06.958652 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-e43185ee-06ee-4206-a766-04cbefababb4 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Calling method '.version_select at 0x7fe148241d30>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:06.977943 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-42aaa966-7fe9-4c66-a4ed-90ab5e756b68 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:06.978405 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-42aaa966-7fe9-4c66-a4ed-90ab5e756b68 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:06.981221 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-42aaa966-7fe9-4c66-a4ed-90ab5e756b68 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:06.985961 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-42aaa966-7fe9-4c66-a4ed-90ab5e756b68 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:07.382430 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-e43185ee-06ee-4206-a766-04cbefababb4 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] HTTP exception thrown: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-e43185ee-06ee-4206-a766-04cbefababb4 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Request method failure captured: Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: DELETE /compute/v2.1/os-volumes/b56d7a6a-f887-45e0-adaa-85b66c243ccb HTTP/1.1 Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudEnQmpAymQrX9X_njuCWdQ_0qDcwmYuzbUhGAnJCpC7Tv95f089EQU-9LW9qcZDJlyDOBqvVbhcMcB92vWo22YZOaUrREK9xXo_X0L2ENGYxD2SAU5VdOJ_1g8bwgF_E0uCUoNdQQpgcAFN1vQOXlUa3ud_u6mkQ3pYV7E1v22xSdA Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 4b12bd7199c94e6392710d44c8b8c24e Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-299446724 Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:48:07.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:48:07.387764 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b12bd7199c94e6392710d44c8b8c24e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b12bd7199c94e6392710d44c8b8c24e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b12bd7199c94e6392710d44c8b8c24e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b12bd7199c94e6392710d44c8b8c24e", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:48:07.387764 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-VolumesSnapshotsTestJSON-299446724 Jun 27 15:48:07.387764 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 4b12bd7199c94e6392710d44c8b8c24e Jun 27 15:48:07.387764 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-299446724 Jun 27 15:48:07.387764 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-VolumesSnapshotsTestJSON-299446724-project Jun 27 15:48:07.387764 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:48:07.387764 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:48:07.387764 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: 61c7ee6276174c5f88e86810f632e690 Jun 27 15:48:07.387764 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-VolumesSnapshotsTestJSON-299446724-project Jun 27 15:48:07.387764 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: Jun 27 15:48:07.387764 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. Jun 27 15:48:07.387764 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': 'b56d7a6a-f887-45e0-adaa-85b66c243ccb'} Jun 27 15:48:07.387764 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:48:07.388438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:48:07.388438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:48:07.388438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:48:07.388438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 15:48:07.388438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 15:48:07.388438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 15:48:07.388438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 15:48:07.388438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 15:48:07.388438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 15:48:07.388438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 15:48:07.388438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 15:48:07.388438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:48:07.388438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:48:07.388438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:48:07.388438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:48:07.388438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. (HTTP 404) (Request-ID: req-4ff67ffd-4a76-4369-96a5-47a69c8b8aef) Jun 27 15:48:07.388438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:07.388438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:48:07.388438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:07.389458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:48:07.389458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 15:48:07.389458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 15:48:07.389458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:48:07.389458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:48:07.389458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:48:07.389458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:48:07.389458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:48:07.389458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:48:07.389458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:48:07.389458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:48:07.389458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 15:48:07.389458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 15:48:07.389458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 15:48:07.389458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 15:48:07.389458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 15:48:07.389458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 15:48:07.389458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 15:48:07.389458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 15:48:07.392148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:48:07.392148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:48:07.392148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:48:07.392148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:48:07.392148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. Jun 27 15:48:07.392148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:07.392148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:48:07.392148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:07.392148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:48:07.392148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:48:07.392148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:48:07.392148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:48:07.392148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:48:07.392148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:48:07.392148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:48:07.392148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:48:07.392148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:48:07.392148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 15:48:07.392148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:48:07.394801 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. Jun 27 15:48:07.394801 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:07.394801 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:48:07.394801 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:07.394801 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:48:07.394801 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:48:07.394801 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:48:07.394801 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:48:07.394801 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:48:07.394801 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. Jun 27 15:48:07.394801 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:07.398937 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-e43185ee-06ee-4206-a766-04cbefababb4 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Returning 404 to user: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:48:07.400100 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-e43185ee-06ee-4206-a766-04cbefababb4 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/b56d7a6a-f887-45e0-adaa-85b66c243ccb" status: 404 len: 109 microversion: 2.1 time: 0.468490 Jun 27 15:48:07.405023 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 18/33] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 27 15:48:06 2022] DELETE /compute/v2.1/os-volumes/b56d7a6a-f887-45e0-adaa-85b66c243ccb => generated 109 bytes in 474 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:48:07.411337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-5f35bc1c-08dd-4f17-86cc-848caf679f59 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Calling method '.version_select at 0x7fe14830b1f0>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:07.567323 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-5f35bc1c-08dd-4f17-86cc-848caf679f59 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] HTTP exception thrown: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-5f35bc1c-08dd-4f17-86cc-848caf679f59 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Request method failure captured: Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/os-volumes/b56d7a6a-f887-45e0-adaa-85b66c243ccb HTTP/1.1 Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudEnQmpAymQrX9X_njuCWdQ_0qDcwmYuzbUhGAnJCpC7Tv95f089EQU-9LW9qcZDJlyDOBqvVbhcMcB92vWo22YZOaUrREK9xXo_X0L2ENGYxD2SAU5VdOJ_1g8bwgF_E0uCUoNdQQpgcAFN1vQOXlUa3ud_u6mkQ3pYV7E1v22xSdA Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 4b12bd7199c94e6392710d44c8b8c24e Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-299446724 Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:48:07.571561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:48:07.572705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b12bd7199c94e6392710d44c8b8c24e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b12bd7199c94e6392710d44c8b8c24e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b12bd7199c94e6392710d44c8b8c24e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b12bd7199c94e6392710d44c8b8c24e", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:48:07.572705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-VolumesSnapshotsTestJSON-299446724 Jun 27 15:48:07.572705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 4b12bd7199c94e6392710d44c8b8c24e Jun 27 15:48:07.572705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-299446724 Jun 27 15:48:07.572705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-VolumesSnapshotsTestJSON-299446724-project Jun 27 15:48:07.572705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:48:07.572705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:48:07.572705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: 61c7ee6276174c5f88e86810f632e690 Jun 27 15:48:07.572705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-VolumesSnapshotsTestJSON-299446724-project Jun 27 15:48:07.572705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: Jun 27 15:48:07.572705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. Jun 27 15:48:07.572705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': 'b56d7a6a-f887-45e0-adaa-85b66c243ccb'} Jun 27 15:48:07.572705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:48:07.574151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:48:07.574151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:48:07.574151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:48:07.574151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:48:07.574151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:48:07.574151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:48:07.574151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:48:07.574151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:48:07.574151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:48:07.574151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:48:07.574151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:48:07.574151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:48:07.574151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:48:07.574151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:48:07.574151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:48:07.574151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. (HTTP 404) (Request-ID: req-05e9068d-7c17-41ab-a0e1-7a9647210783) Jun 27 15:48:07.574151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:07.574151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:48:07.574151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:07.576200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:48:07.576200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 15:48:07.576200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 15:48:07.576200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:48:07.576200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:48:07.576200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:48:07.576200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:48:07.576200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:48:07.576200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:48:07.576200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:48:07.576200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:48:07.576200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:48:07.576200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:48:07.576200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:48:07.576200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:48:07.576200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:48:07.576200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:48:07.576200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:48:07.576200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:48:07.578641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:48:07.578641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:48:07.578641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:48:07.578641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:48:07.578641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. Jun 27 15:48:07.578641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:07.578641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:48:07.578641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:07.578641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:48:07.578641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:48:07.578641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:48:07.578641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:48:07.578641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:48:07.578641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:48:07.578641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:48:07.578641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:48:07.578641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:48:07.578641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 15:48:07.578641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:48:07.580647 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. Jun 27 15:48:07.580647 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:07.580647 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:48:07.580647 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:07.580647 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:48:07.580647 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:48:07.580647 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:48:07.580647 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:48:07.580647 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:48:07.580647 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. Jun 27 15:48:07.580647 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:48:07.580647 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-5f35bc1c-08dd-4f17-86cc-848caf679f59 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] Returning 404 to user: Volume b56d7a6a-f887-45e0-adaa-85b66c243ccb could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:48:07.580647 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-5f35bc1c-08dd-4f17-86cc-848caf679f59 tempest-VolumesSnapshotsTestJSON-299446724 tempest-VolumesSnapshotsTestJSON-299446724-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b56d7a6a-f887-45e0-adaa-85b66c243ccb" status: 404 len: 109 microversion: 2.1 time: 0.168114 Jun 27 15:48:07.580647 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 19/34] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 27 15:48:07 2022] GET /compute/v2.1/os-volumes/b56d7a6a-f887-45e0-adaa-85b66c243ccb => generated 109 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:48:07.827978 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-42aaa966-7fe9-4c66-a4ed-90ab5e756b68 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:07.842786 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-42aaa966-7fe9-4c66-a4ed-90ab5e756b68 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1266 microversion: 2.1 time: 0.935869 Jun 27 15:48:07.845279 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 16/35] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:06 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1266 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:08.861988 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-45926b77-4cbe-469c-9e7b-a0bb858ad246 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:08.863292 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-45926b77-4cbe-469c-9e7b-a0bb858ad246 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:08.876488 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-45926b77-4cbe-469c-9e7b-a0bb858ad246 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:08.877190 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-45926b77-4cbe-469c-9e7b-a0bb858ad246 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:08.878241 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-45926b77-4cbe-469c-9e7b-a0bb858ad246 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:08.878831 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-45926b77-4cbe-469c-9e7b-a0bb858ad246 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:09.058208 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-e0c1aaf6-23bb-4e77-af09-83f0f0459f39 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1879093470", "imageRef": "11f9be98-90d6-4c67-8d66-0b944f5a2a2b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:48:09.232498 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-45926b77-4cbe-469c-9e7b-a0bb858ad246 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:09.240459 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-45926b77-4cbe-469c-9e7b-a0bb858ad246 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1272 microversion: 2.1 time: 0.382121 Jun 27 15:48:09.250657 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 17/36] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:08 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1272 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:09.396931 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.network.neutron [None req-e0c1aaf6-23bb-4e77-af09-83f0f0459f39 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] validate_networks() for [('3b3c98a4-e5c9-4af6-926d-da3be9d57070', None, None, None, None, None)] {{(pid=129472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:48:10.258526 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b4925a6f-7506-4c51-a75e-12893f928e2f tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:10.259964 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b4925a6f-7506-4c51-a75e-12893f928e2f tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:10.275637 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b4925a6f-7506-4c51-a75e-12893f928e2f tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:10.276474 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b4925a6f-7506-4c51-a75e-12893f928e2f tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:10.279197 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b4925a6f-7506-4c51-a75e-12893f928e2f tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:10.279899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b4925a6f-7506-4c51-a75e-12893f928e2f tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:10.711585 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b4925a6f-7506-4c51-a75e-12893f928e2f tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:10.732748 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b4925a6f-7506-4c51-a75e-12893f928e2f tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1272 microversion: 2.1 time: 0.478389 Jun 27 15:48:10.745687 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 18/37] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:10 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1272 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:48:11.767057 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d61742c0-b50e-48bd-bd41-1f17c659e50a tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:11.768479 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d61742c0-b50e-48bd-bd41-1f17c659e50a tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:11.778090 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=2 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:48:11.783889 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d61742c0-b50e-48bd-bd41-1f17c659e50a tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:11.786264 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d61742c0-b50e-48bd-bd41-1f17c659e50a tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:11.787295 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d61742c0-b50e-48bd-bd41-1f17c659e50a tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:11.790256 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d61742c0-b50e-48bd-bd41-1f17c659e50a tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:13.043706 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d61742c0-b50e-48bd-bd41-1f17c659e50a tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:13.054866 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d61742c0-b50e-48bd-bd41-1f17c659e50a tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 1.295359 Jun 27 15:48:13.090007 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 19/38] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:11 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:14.095298 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ca21041a-9c11-4984-9297-32783d51a44a tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:14.096060 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-ca21041a-9c11-4984-9297-32783d51a44a tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:14.107409 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=10 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:48:14.114035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ca21041a-9c11-4984-9297-32783d51a44a tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:14.129171 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ca21041a-9c11-4984-9297-32783d51a44a tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:14.130573 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ca21041a-9c11-4984-9297-32783d51a44a tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:14.149234 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ca21041a-9c11-4984-9297-32783d51a44a tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:15.569881 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-ca21041a-9c11-4984-9297-32783d51a44a tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:15.583081 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-ca21041a-9c11-4984-9297-32783d51a44a tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 1.491888 Jun 27 15:48:15.603625 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 20/39] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:14 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:48:15.775693 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-e0c1aaf6-23bb-4e77-af09-83f0f0459f39 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Flavor limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:48:15.776402 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-e0c1aaf6-23bb-4e77-af09-83f0f0459f39 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Image limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:48:15.777033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-e0c1aaf6-23bb-4e77-af09-83f0f0459f39 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Flavor pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:48:15.778033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-e0c1aaf6-23bb-4e77-af09-83f0f0459f39 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Image pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:48:15.780614 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-e0c1aaf6-23bb-4e77-af09-83f0f0459f39 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:48:15.825570 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e0c1aaf6-23bb-4e77-af09-83f0f0459f39 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:15.826059 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e0c1aaf6-23bb-4e77-af09-83f0f0459f39 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:15.826859 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e0c1aaf6-23bb-4e77-af09-83f0f0459f39 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:15.827292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e0c1aaf6-23bb-4e77-af09-83f0f0459f39 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:15.885979 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-9750a26c-5760-4c62-8976-a08082abec07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2017018629", "imageRef": "11f9be98-90d6-4c67-8d66-0b944f5a2a2b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd279a41-3cb0-4e0d-b118-71a558c9606c"}], "security_groups": [{"name": "tempest-securitygroup--307895946"}], "key_name": "tempest-keypair-1474949121", "user_data": "}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:48:16.028872 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-e0c1aaf6-23bb-4e77-af09-83f0f0459f39 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Getting quotas for project f5e448e724fa479ea693168592686391. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:48:16.052139 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-e0c1aaf6-23bb-4e77-af09-83f0f0459f39 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Getting quotas for user 1a7a81da8acf40849a9ea86e2542ae6a and project f5e448e724fa479ea693168592686391. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:48:16.099203 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-e0c1aaf6-23bb-4e77-af09-83f0f0459f39 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Going to run 1 instances... {{(pid=129472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:48:16.110367 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-e0c1aaf6-23bb-4e77-af09-83f0f0459f39 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11f9be98-90d6-4c67-8d66-0b944f5a2a2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:48:16.335460 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-e0c1aaf6-23bb-4e77-af09-83f0f0459f39 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.668998 Jun 27 15:48:16.336773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 15:48:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 7671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:48:16.365347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8623aeac-079c-4551-b86d-11761eaebc36 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:16.365783 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8623aeac-079c-4551-b86d-11761eaebc36 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:16.511240 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.network.neutron [None req-9750a26c-5760-4c62-8976-a08082abec07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] validate_networks() for [('bd279a41-3cb0-4e0d-b118-71a558c9606c', None, None, None, None, None)] {{(pid=129473) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:48:17.292396 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8623aeac-079c-4551-b86d-11761eaebc36 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:17.346723 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-8623aeac-079c-4551-b86d-11761eaebc36 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1222 microversion: 2.1 time: 1.003359 Jun 27 15:48:17.347335 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 21/41] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:16 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1222 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:17.359976 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8e5447be-06da-4e41-bd83-cb79103d9e96 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:17.377948 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8e5447be-06da-4e41-bd83-cb79103d9e96 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:17.413522 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8e5447be-06da-4e41-bd83-cb79103d9e96 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:17.425596 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8e5447be-06da-4e41-bd83-cb79103d9e96 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:17.429500 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8e5447be-06da-4e41-bd83-cb79103d9e96 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:17.434265 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8e5447be-06da-4e41-bd83-cb79103d9e96 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:19.097443 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8e5447be-06da-4e41-bd83-cb79103d9e96 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:19.119091 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-8e5447be-06da-4e41-bd83-cb79103d9e96 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 1.764292 Jun 27 15:48:19.119796 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 22/42] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:17 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:19.788463 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-9750a26c-5760-4c62-8976-a08082abec07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Flavor limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:48:19.789365 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-9750a26c-5760-4c62-8976-a08082abec07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Image limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:48:19.789365 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-9750a26c-5760-4c62-8976-a08082abec07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Flavor pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:48:19.789820 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-9750a26c-5760-4c62-8976-a08082abec07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Image pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:48:19.790245 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-9750a26c-5760-4c62-8976-a08082abec07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:48:19.812254 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9750a26c-5760-4c62-8976-a08082abec07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:19.812718 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9750a26c-5760-4c62-8976-a08082abec07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:19.813553 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9750a26c-5760-4c62-8976-a08082abec07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:19.814610 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9750a26c-5760-4c62-8976-a08082abec07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:19.889998 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-9750a26c-5760-4c62-8976-a08082abec07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Getting quotas for project 5b5846565bf74c5cac3ff5c3168cfd48. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:48:19.901458 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-9750a26c-5760-4c62-8976-a08082abec07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Getting quotas for user d35c652539f443d4895b5f81461833ba and project 5b5846565bf74c5cac3ff5c3168cfd48. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:48:19.966581 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-9750a26c-5760-4c62-8976-a08082abec07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Going to run 1 instances... {{(pid=129473) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:48:19.969031 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-9750a26c-5760-4c62-8976-a08082abec07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11f9be98-90d6-4c67-8d66-0b944f5a2a2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:48:20.132350 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-9750a26c-5760-4c62-8976-a08082abec07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.253458 Jun 27 15:48:20.133169 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 21/43] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 15:48:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 4258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:48:20.143346 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-16d369b6-364d-47c3-8b05-edb80117512c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1087923849", "imageRef": "11f9be98-90d6-4c67-8d66-0b944f5a2a2b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:48:20.263628 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.network.neutron [None req-16d369b6-364d-47c3-8b05-edb80117512c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] validate_networks() for [('3b3c98a4-e5c9-4af6-926d-da3be9d57070', None, None, None, None, None)] {{(pid=129473) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:48:20.271861 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-06a3f0c4-4c04-452a-9083-12fb1b18767e req-b1c9c735-bd47-44b5-b3c5-76378c286ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b4fbc86-ac2c-4bda-b073-02c52f0559f1", "tag": "8c661832-e9de-45b0-be49-833df2b9cc70"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:48:20.340748 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-06a3f0c4-4c04-452a-9083-12fb1b18767e req-b1c9c735-bd47-44b5-b3c5-76378c286ad8 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:20.354084 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-06a3f0c4-4c04-452a-9083-12fb1b18767e req-b1c9c735-bd47-44b5-b3c5-76378c286ad8 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:20.427937 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-06a3f0c4-4c04-452a-9083-12fb1b18767e req-b1c9c735-bd47-44b5-b3c5-76378c286ad8 service nova] Creating event network-changed:8c661832-e9de-45b0-be49-833df2b9cc70 for instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 on hv-cinder-84780 Jun 27 15:48:20.430178 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-06a3f0c4-4c04-452a-9083-12fb1b18767e req-b1c9c735-bd47-44b5-b3c5-76378c286ad8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129472) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 27 15:48:20.433087 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e977da02-0a9f-4df6-a532-74393d2356ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:20.435375 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e977da02-0a9f-4df6-a532-74393d2356ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:20.438632 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e977da02-0a9f-4df6-a532-74393d2356ba None None] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:20.443138 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e977da02-0a9f-4df6-a532-74393d2356ba None None] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:20.478177 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.compute.rpcapi [None req-e977da02-0a9f-4df6-a532-74393d2356ba None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 27 15:48:20.480464 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e977da02-0a9f-4df6-a532-74393d2356ba None None] Releasing lock "compute-rpcapi-router" {{(pid=129472) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 27 15:48:20.550167 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-e977da02-0a9f-4df6-a532-74393d2356ba None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.425981 Jun 27 15:48:20.554024 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 23/44] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:48:20.579817 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ac43a14b-1575-403f-9de1-6f7498f11f5d tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:20.580534 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-ac43a14b-1575-403f-9de1-6f7498f11f5d tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:20.614729 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ac43a14b-1575-403f-9de1-6f7498f11f5d tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:20.622233 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ac43a14b-1575-403f-9de1-6f7498f11f5d tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:20.625463 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ac43a14b-1575-403f-9de1-6f7498f11f5d tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:20.634258 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ac43a14b-1575-403f-9de1-6f7498f11f5d tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:21.514601 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ac43a14b-1575-403f-9de1-6f7498f11f5d tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:21.527657 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ac43a14b-1575-403f-9de1-6f7498f11f5d tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.972281 Jun 27 15:48:21.533960 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 24/45] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:20 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:21.563389 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c871ac4f-24bc-4ab8-82f0-e28e1e7ae050 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:21.565215 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c871ac4f-24bc-4ab8-82f0-e28e1e7ae050 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:21.595680 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c871ac4f-24bc-4ab8-82f0-e28e1e7ae050 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:21.603310 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c871ac4f-24bc-4ab8-82f0-e28e1e7ae050 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:21.608006 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c871ac4f-24bc-4ab8-82f0-e28e1e7ae050 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:21.611469 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c871ac4f-24bc-4ab8-82f0-e28e1e7ae050 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:21.892386 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-c871ac4f-24bc-4ab8-82f0-e28e1e7ae050 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:21.925363 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c871ac4f-24bc-4ab8-82f0-e28e1e7ae050 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1242 microversion: 2.1 time: 0.387380 Jun 27 15:48:21.939571 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 25/46] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:21 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1242 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:22.261734 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-16d369b6-364d-47c3-8b05-edb80117512c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Flavor limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:48:22.262808 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-16d369b6-364d-47c3-8b05-edb80117512c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Image limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:48:22.263480 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-16d369b6-364d-47c3-8b05-edb80117512c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Flavor pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:48:22.264083 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-16d369b6-364d-47c3-8b05-edb80117512c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Image pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:48:22.265149 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-16d369b6-364d-47c3-8b05-edb80117512c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:48:22.269417 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:48:22.312891 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-16d369b6-364d-47c3-8b05-edb80117512c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:22.319358 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-16d369b6-364d-47c3-8b05-edb80117512c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:22.323479 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-16d369b6-364d-47c3-8b05-edb80117512c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:22.331068 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-16d369b6-364d-47c3-8b05-edb80117512c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:22.371786 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=41 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:48:22.391970 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-16d369b6-364d-47c3-8b05-edb80117512c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Getting quotas for project f5e448e724fa479ea693168592686391. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:48:22.418878 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-16d369b6-364d-47c3-8b05-edb80117512c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Getting quotas for user 1a7a81da8acf40849a9ea86e2542ae6a and project f5e448e724fa479ea693168592686391. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:48:22.443827 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-16d369b6-364d-47c3-8b05-edb80117512c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Going to run 1 instances... {{(pid=129473) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:48:22.447758 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-16d369b6-364d-47c3-8b05-edb80117512c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11f9be98-90d6-4c67-8d66-0b944f5a2a2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:48:22.551119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-7ef29394-14ab-4806-8691-e39a1f08915c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:22.552505 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-7ef29394-14ab-4806-8691-e39a1f08915c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:22.571366 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7ef29394-14ab-4806-8691-e39a1f08915c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:22.574547 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7ef29394-14ab-4806-8691-e39a1f08915c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:22.580119 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-16d369b6-364d-47c3-8b05-edb80117512c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.438723 Jun 27 15:48:22.580986 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7ef29394-14ab-4806-8691-e39a1f08915c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:22.583833 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 22/47] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 15:48:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 2446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:48:22.585202 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7ef29394-14ab-4806-8691-e39a1f08915c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:22.596260 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-933bfce9-482b-4928-a3fe-b089a2755e03 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:22.600784 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-933bfce9-482b-4928-a3fe-b089a2755e03 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:22.930795 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-933bfce9-482b-4928-a3fe-b089a2755e03 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:22.940059 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-933bfce9-482b-4928-a3fe-b089a2755e03 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1222 microversion: 2.1 time: 0.349280 Jun 27 15:48:22.946676 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 23/48] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:22 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1222 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:22.978202 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-2a0581c2-1780-4723-93ba-8fa99142713b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:22.984063 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-2a0581c2-1780-4723-93ba-8fa99142713b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:23.010638 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2a0581c2-1780-4723-93ba-8fa99142713b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:23.011505 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2a0581c2-1780-4723-93ba-8fa99142713b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:23.017736 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2a0581c2-1780-4723-93ba-8fa99142713b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:23.018985 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2a0581c2-1780-4723-93ba-8fa99142713b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:23.406565 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2a0581c2-1780-4723-93ba-8fa99142713b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:23.431968 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-2a0581c2-1780-4723-93ba-8fa99142713b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1298 microversion: 2.1 time: 0.479213 Jun 27 15:48:23.436181 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 24/49] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:22 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1298 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:23.708542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-7ef29394-14ab-4806-8691-e39a1f08915c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:23.721741 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-7ef29394-14ab-4806-8691-e39a1f08915c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 1.174276 Jun 27 15:48:23.730118 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 26/50] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:22 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:48:23.967228 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c8a8142e-db4e-47e6-ae41-fdc06dea9478 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:23.967861 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c8a8142e-db4e-47e6-ae41-fdc06dea9478 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:23.998652 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c8a8142e-db4e-47e6-ae41-fdc06dea9478 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:23.999791 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c8a8142e-db4e-47e6-ae41-fdc06dea9478 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:24.009606 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c8a8142e-db4e-47e6-ae41-fdc06dea9478 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:24.010371 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c8a8142e-db4e-47e6-ae41-fdc06dea9478 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:24.216654 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-c8a8142e-db4e-47e6-ae41-fdc06dea9478 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:24.234091 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c8a8142e-db4e-47e6-ae41-fdc06dea9478 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1226 microversion: 2.1 time: 0.265709 Jun 27 15:48:24.234784 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 25/51] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:23 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1226 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:24.454834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-dfe7dcb5-3de8-486a-bde4-0b982a0f3807 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:24.455695 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-dfe7dcb5-3de8-486a-bde4-0b982a0f3807 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:24.469108 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dfe7dcb5-3de8-486a-bde4-0b982a0f3807 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:24.479382 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dfe7dcb5-3de8-486a-bde4-0b982a0f3807 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:24.481611 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dfe7dcb5-3de8-486a-bde4-0b982a0f3807 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:24.482503 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dfe7dcb5-3de8-486a-bde4-0b982a0f3807 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:24.704641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-dfe7dcb5-3de8-486a-bde4-0b982a0f3807 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:24.720016 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-dfe7dcb5-3de8-486a-bde4-0b982a0f3807 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1296 microversion: 2.1 time: 0.269509 Jun 27 15:48:24.723932 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 27/52] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:24 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1296 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:48:24.741807 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-044a8102-e2ec-437f-beca-a43ce2fccf7e tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:24.742373 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-044a8102-e2ec-437f-beca-a43ce2fccf7e tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:24.758201 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-044a8102-e2ec-437f-beca-a43ce2fccf7e tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:24.758785 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-044a8102-e2ec-437f-beca-a43ce2fccf7e tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:24.759608 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-044a8102-e2ec-437f-beca-a43ce2fccf7e tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:24.760040 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-044a8102-e2ec-437f-beca-a43ce2fccf7e tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:25.155692 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-044a8102-e2ec-437f-beca-a43ce2fccf7e tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:25.166078 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-044a8102-e2ec-437f-beca-a43ce2fccf7e tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.429530 Jun 27 15:48:25.166661 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 26/53] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:24 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:25.253270 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f5a9ab93-05b2-478c-8b47-80a1606f20b8 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:25.254135 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f5a9ab93-05b2-478c-8b47-80a1606f20b8 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:25.283861 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f5a9ab93-05b2-478c-8b47-80a1606f20b8 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:25.286966 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f5a9ab93-05b2-478c-8b47-80a1606f20b8 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:25.294856 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f5a9ab93-05b2-478c-8b47-80a1606f20b8 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:25.295346 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f5a9ab93-05b2-478c-8b47-80a1606f20b8 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:25.558571 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f5a9ab93-05b2-478c-8b47-80a1606f20b8 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:25.569339 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f5a9ab93-05b2-478c-8b47-80a1606f20b8 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1292 microversion: 2.1 time: 0.320856 Jun 27 15:48:25.580801 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 28/54] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:25 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1292 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:25.756084 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-8c911f39-dfd2-4073-bb34-3d8622488026 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:25.758246 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-8c911f39-dfd2-4073-bb34-3d8622488026 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:25.790848 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8c911f39-dfd2-4073-bb34-3d8622488026 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:25.793566 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8c911f39-dfd2-4073-bb34-3d8622488026 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:25.796088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8c911f39-dfd2-4073-bb34-3d8622488026 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:25.812088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8c911f39-dfd2-4073-bb34-3d8622488026 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:26.038839 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-8c911f39-dfd2-4073-bb34-3d8622488026 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:26.070028 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-8c911f39-dfd2-4073-bb34-3d8622488026 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1296 microversion: 2.1 time: 0.331029 Jun 27 15:48:26.073262 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 27/55] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:25 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1296 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:26.190390 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c83f38e4-70d2-4f3c-acd2-95098640af85 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:26.191168 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c83f38e4-70d2-4f3c-acd2-95098640af85 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:26.202033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c83f38e4-70d2-4f3c-acd2-95098640af85 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:26.202627 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c83f38e4-70d2-4f3c-acd2-95098640af85 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:26.203443 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c83f38e4-70d2-4f3c-acd2-95098640af85 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:26.203896 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c83f38e4-70d2-4f3c-acd2-95098640af85 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:26.575462 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-c83f38e4-70d2-4f3c-acd2-95098640af85 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:26.590156 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-9c354dff-690f-4e90-8252-c1c4b0bfce0a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:26.591621 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-9c354dff-690f-4e90-8252-c1c4b0bfce0a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:26.600719 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c83f38e4-70d2-4f3c-acd2-95098640af85 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.416534 Jun 27 15:48:26.611976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9c354dff-690f-4e90-8252-c1c4b0bfce0a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:26.612606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 29/56] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:26 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:26.613286 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9c354dff-690f-4e90-8252-c1c4b0bfce0a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:26.614578 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9c354dff-690f-4e90-8252-c1c4b0bfce0a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:26.615282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9c354dff-690f-4e90-8252-c1c4b0bfce0a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:26.730603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-9c354dff-690f-4e90-8252-c1c4b0bfce0a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:26.739573 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-9c354dff-690f-4e90-8252-c1c4b0bfce0a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1292 microversion: 2.1 time: 0.153609 Jun 27 15:48:26.749560 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 28/57] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:26 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1292 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:27.096791 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-180f7a0d-5794-45e3-b099-b6f8102941bf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:27.097498 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-180f7a0d-5794-45e3-b099-b6f8102941bf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:27.099683 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:48:27.106428 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-180f7a0d-5794-45e3-b099-b6f8102941bf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:27.106936 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-180f7a0d-5794-45e3-b099-b6f8102941bf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:27.107713 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-180f7a0d-5794-45e3-b099-b6f8102941bf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:27.108152 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-180f7a0d-5794-45e3-b099-b6f8102941bf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:27.206989 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-180f7a0d-5794-45e3-b099-b6f8102941bf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:27.221503 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-180f7a0d-5794-45e3-b099-b6f8102941bf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1296 microversion: 2.1 time: 0.134714 Jun 27 15:48:27.221910 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 30/58] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:27 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1296 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:27.619262 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-456fb057-0b59-45ed-a1fd-a9521154ca56 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:27.620595 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-456fb057-0b59-45ed-a1fd-a9521154ca56 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:27.626090 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-456fb057-0b59-45ed-a1fd-a9521154ca56 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:27.626747 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-456fb057-0b59-45ed-a1fd-a9521154ca56 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:27.627899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-456fb057-0b59-45ed-a1fd-a9521154ca56 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:27.628478 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-456fb057-0b59-45ed-a1fd-a9521154ca56 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:27.759809 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-5bfee128-ab96-4233-8e4f-95b10ef43539 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:27.760436 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-5bfee128-ab96-4233-8e4f-95b10ef43539 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:27.764196 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=12 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:48:27.770087 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5bfee128-ab96-4233-8e4f-95b10ef43539 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:27.770770 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5bfee128-ab96-4233-8e4f-95b10ef43539 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:27.771645 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5bfee128-ab96-4233-8e4f-95b10ef43539 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:27.772266 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5bfee128-ab96-4233-8e4f-95b10ef43539 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:27.845221 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-456fb057-0b59-45ed-a1fd-a9521154ca56 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:27.860458 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-456fb057-0b59-45ed-a1fd-a9521154ca56 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.245764 Jun 27 15:48:27.872272 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 29/59] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:27 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:27.877668 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-5bfee128-ab96-4233-8e4f-95b10ef43539 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:27.887171 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-5bfee128-ab96-4233-8e4f-95b10ef43539 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1292 microversion: 2.1 time: 0.132850 Jun 27 15:48:27.896154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 31/60] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:27 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1292 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:48:28.239237 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-519f534b-7c03-4195-8446-d88ef2e3bb6f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:28.240281 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-519f534b-7c03-4195-8446-d88ef2e3bb6f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:28.254279 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-519f534b-7c03-4195-8446-d88ef2e3bb6f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:28.257747 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-519f534b-7c03-4195-8446-d88ef2e3bb6f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:28.259757 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-519f534b-7c03-4195-8446-d88ef2e3bb6f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:28.263692 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-519f534b-7c03-4195-8446-d88ef2e3bb6f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:28.412687 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-519f534b-7c03-4195-8446-d88ef2e3bb6f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:28.425772 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-519f534b-7c03-4195-8446-d88ef2e3bb6f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1296 microversion: 2.1 time: 0.190937 Jun 27 15:48:28.426782 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 30/61] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:28 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1296 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:28.879555 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a3ffaccd-5caf-47eb-b3f9-3cdcb20ef4e3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:28.880193 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a3ffaccd-5caf-47eb-b3f9-3cdcb20ef4e3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:28.888511 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a3ffaccd-5caf-47eb-b3f9-3cdcb20ef4e3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:28.889193 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a3ffaccd-5caf-47eb-b3f9-3cdcb20ef4e3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:28.890205 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a3ffaccd-5caf-47eb-b3f9-3cdcb20ef4e3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:28.890837 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a3ffaccd-5caf-47eb-b3f9-3cdcb20ef4e3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:28.905513 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b7dbac09-bdc6-4c03-9ce6-6d4aadb13821 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:28.906400 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b7dbac09-bdc6-4c03-9ce6-6d4aadb13821 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:28.915674 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b7dbac09-bdc6-4c03-9ce6-6d4aadb13821 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:28.918716 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b7dbac09-bdc6-4c03-9ce6-6d4aadb13821 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:28.918716 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b7dbac09-bdc6-4c03-9ce6-6d4aadb13821 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:28.918716 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b7dbac09-bdc6-4c03-9ce6-6d4aadb13821 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:29.074423 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b7dbac09-bdc6-4c03-9ce6-6d4aadb13821 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:29.084081 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b7dbac09-bdc6-4c03-9ce6-6d4aadb13821 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1292 microversion: 2.1 time: 0.182760 Jun 27 15:48:29.087697 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 31/62] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:28 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1292 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:29.166409 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a3ffaccd-5caf-47eb-b3f9-3cdcb20ef4e3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:29.174693 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-a3ffaccd-5caf-47eb-b3f9-3cdcb20ef4e3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.299980 Jun 27 15:48:29.176326 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 32/63] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:28 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:29.448329 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-eb0cde24-5003-4552-b7eb-5601b517a47e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:29.449236 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-eb0cde24-5003-4552-b7eb-5601b517a47e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:29.457236 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eb0cde24-5003-4552-b7eb-5601b517a47e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:29.457711 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eb0cde24-5003-4552-b7eb-5601b517a47e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:29.458529 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eb0cde24-5003-4552-b7eb-5601b517a47e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:29.458957 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eb0cde24-5003-4552-b7eb-5601b517a47e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:29.550170 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-eb0cde24-5003-4552-b7eb-5601b517a47e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:29.559811 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-eb0cde24-5003-4552-b7eb-5601b517a47e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1296 microversion: 2.1 time: 0.118089 Jun 27 15:48:29.561383 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 32/64] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:29 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1296 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:30.103000 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-29a44c9c-f761-4e16-80d3-4a7c03496736 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:30.103619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-29a44c9c-f761-4e16-80d3-4a7c03496736 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:30.109710 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-29a44c9c-f761-4e16-80d3-4a7c03496736 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:30.110498 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-29a44c9c-f761-4e16-80d3-4a7c03496736 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:30.111963 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-29a44c9c-f761-4e16-80d3-4a7c03496736 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:30.112677 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-29a44c9c-f761-4e16-80d3-4a7c03496736 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:30.195280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-29a44c9c-f761-4e16-80d3-4a7c03496736 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:30.195381 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3805b375-ec34-4cb8-b9dd-31baf748c834 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:30.195787 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3805b375-ec34-4cb8-b9dd-31baf748c834 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:30.201943 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-29a44c9c-f761-4e16-80d3-4a7c03496736 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1292 microversion: 2.1 time: 0.104330 Jun 27 15:48:30.202962 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 33/65] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:30 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1292 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:30.213746 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3805b375-ec34-4cb8-b9dd-31baf748c834 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:30.214201 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3805b375-ec34-4cb8-b9dd-31baf748c834 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:30.214967 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3805b375-ec34-4cb8-b9dd-31baf748c834 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:30.215541 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3805b375-ec34-4cb8-b9dd-31baf748c834 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:30.466383 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3805b375-ec34-4cb8-b9dd-31baf748c834 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:30.479090 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3805b375-ec34-4cb8-b9dd-31baf748c834 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.289742 Jun 27 15:48:30.480250 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 33/66] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:30 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:30.578744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-4892491d-2690-413a-ac48-8fe4295ba985 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:30.579366 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-4892491d-2690-413a-ac48-8fe4295ba985 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:30.581296 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=4 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:48:30.587905 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4892491d-2690-413a-ac48-8fe4295ba985 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:30.588383 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4892491d-2690-413a-ac48-8fe4295ba985 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:30.589174 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4892491d-2690-413a-ac48-8fe4295ba985 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:30.589617 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4892491d-2690-413a-ac48-8fe4295ba985 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:30.657090 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-4892491d-2690-413a-ac48-8fe4295ba985 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:30.668457 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-4892491d-2690-413a-ac48-8fe4295ba985 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1296 microversion: 2.1 time: 0.093527 Jun 27 15:48:30.669543 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 34/67] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:30 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:31.220799 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-89479913-31e0-4a78-bd4c-729dd377f0d6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:31.221457 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-89479913-31e0-4a78-bd4c-729dd377f0d6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:31.233593 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-89479913-31e0-4a78-bd4c-729dd377f0d6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:31.234081 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-89479913-31e0-4a78-bd4c-729dd377f0d6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:31.234913 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-89479913-31e0-4a78-bd4c-729dd377f0d6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:31.235351 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-89479913-31e0-4a78-bd4c-729dd377f0d6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:31.397820 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-89479913-31e0-4a78-bd4c-729dd377f0d6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:31.410363 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-89479913-31e0-4a78-bd4c-729dd377f0d6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1280 microversion: 2.1 time: 0.193319 Jun 27 15:48:31.411214 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 34/68] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:31 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1280 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:31.497611 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-782ddb2b-0b5d-4658-afd8-57250aafb44e tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:31.498358 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-782ddb2b-0b5d-4658-afd8-57250aafb44e tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:31.513656 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-782ddb2b-0b5d-4658-afd8-57250aafb44e tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:31.514251 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-782ddb2b-0b5d-4658-afd8-57250aafb44e tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:31.517079 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-782ddb2b-0b5d-4658-afd8-57250aafb44e tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:31.517551 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-782ddb2b-0b5d-4658-afd8-57250aafb44e tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:31.687322 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-df163084-6f66-4f81-92ee-c070577337f3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:31.692018 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-df163084-6f66-4f81-92ee-c070577337f3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:31.700798 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-df163084-6f66-4f81-92ee-c070577337f3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:31.701572 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-df163084-6f66-4f81-92ee-c070577337f3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:31.702824 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-df163084-6f66-4f81-92ee-c070577337f3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:31.703530 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-df163084-6f66-4f81-92ee-c070577337f3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:31.838549 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-df163084-6f66-4f81-92ee-c070577337f3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:31.852918 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-df163084-6f66-4f81-92ee-c070577337f3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1296 microversion: 2.1 time: 0.169319 Jun 27 15:48:31.854115 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 35/69] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:31 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1296 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:48:31.925474 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-782ddb2b-0b5d-4658-afd8-57250aafb44e tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:31.938283 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-782ddb2b-0b5d-4658-afd8-57250aafb44e tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.444719 Jun 27 15:48:31.940759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 35/70] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:31 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:32.432820 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ef255b31-9256-446b-9874-859428b2b025 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:32.433499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-ef255b31-9256-446b-9874-859428b2b025 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:32.435382 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=4 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:48:32.450495 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ef255b31-9256-446b-9874-859428b2b025 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:32.451261 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ef255b31-9256-446b-9874-859428b2b025 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:32.452722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ef255b31-9256-446b-9874-859428b2b025 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:32.453220 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ef255b31-9256-446b-9874-859428b2b025 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:32.741917 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-ef255b31-9256-446b-9874-859428b2b025 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:32.752164 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-ef255b31-9256-446b-9874-859428b2b025 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.327654 Jun 27 15:48:32.764881 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 36/71] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:32 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:32.872457 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a8cfa159-71ab-4ca6-84d2-4d11af780c7e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:32.873069 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a8cfa159-71ab-4ca6-84d2-4d11af780c7e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:32.895650 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a8cfa159-71ab-4ca6-84d2-4d11af780c7e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:32.901537 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a8cfa159-71ab-4ca6-84d2-4d11af780c7e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:32.902515 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a8cfa159-71ab-4ca6-84d2-4d11af780c7e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:32.902973 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a8cfa159-71ab-4ca6-84d2-4d11af780c7e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:32.962383 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b12ed634-6a34-4719-95d2-a79070b1cd76 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:32.964244 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b12ed634-6a34-4719-95d2-a79070b1cd76 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:32.978411 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=14 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:48:32.983560 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b12ed634-6a34-4719-95d2-a79070b1cd76 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:32.984028 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b12ed634-6a34-4719-95d2-a79070b1cd76 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:32.988056 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b12ed634-6a34-4719-95d2-a79070b1cd76 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:32.989474 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b12ed634-6a34-4719-95d2-a79070b1cd76 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:33.356968 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a8cfa159-71ab-4ca6-84d2-4d11af780c7e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:33.372701 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-a8cfa159-71ab-4ca6-84d2-4d11af780c7e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.505248 Jun 27 15:48:33.375802 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 36/72] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:32 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:33.377552 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b12ed634-6a34-4719-95d2-a79070b1cd76 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:33.381698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-a26804ff-c373-48bf-b56d-75567fe77f48 req-b35aa1ae-f6bc-4044-89ed-223e3cbb8537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5", "tag": "db62c7bb-5168-441d-a55f-cb931ba441a4"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:48:33.387167 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b12ed634-6a34-4719-95d2-a79070b1cd76 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.431626 Jun 27 15:48:33.387978 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 37/73] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:32 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:33.394013 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-a26804ff-c373-48bf-b56d-75567fe77f48 req-b35aa1ae-f6bc-4044-89ed-223e3cbb8537 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:33.394384 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-a26804ff-c373-48bf-b56d-75567fe77f48 req-b35aa1ae-f6bc-4044-89ed-223e3cbb8537 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:33.421680 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-a26804ff-c373-48bf-b56d-75567fe77f48 req-b35aa1ae-f6bc-4044-89ed-223e3cbb8537 service nova] Creating event network-changed:db62c7bb-5168-441d-a55f-cb931ba441a4 for instance 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 on hv-cinder-84780 Jun 27 15:48:33.437080 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-a26804ff-c373-48bf-b56d-75567fe77f48 req-b35aa1ae-f6bc-4044-89ed-223e3cbb8537 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059208 Jun 27 15:48:33.438084 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 37/74] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:48:33.775835 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-117e666e-2464-4d01-94f5-58941413fc02 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:33.777020 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-117e666e-2464-4d01-94f5-58941413fc02 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:33.783523 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-117e666e-2464-4d01-94f5-58941413fc02 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:33.784084 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-117e666e-2464-4d01-94f5-58941413fc02 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:33.785056 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-117e666e-2464-4d01-94f5-58941413fc02 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:33.785507 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-117e666e-2464-4d01-94f5-58941413fc02 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:33.955591 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-117e666e-2464-4d01-94f5-58941413fc02 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:33.964120 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-117e666e-2464-4d01-94f5-58941413fc02 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.193065 Jun 27 15:48:33.964696 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 38/75] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:33 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:34.392856 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-548d987f-32e9-44bc-ab93-db2ef962a680 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:34.393467 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-548d987f-32e9-44bc-ab93-db2ef962a680 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:34.400812 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-548d987f-32e9-44bc-ab93-db2ef962a680 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:34.401264 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-548d987f-32e9-44bc-ab93-db2ef962a680 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:34.402044 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-548d987f-32e9-44bc-ab93-db2ef962a680 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:34.402485 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-548d987f-32e9-44bc-ab93-db2ef962a680 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:34.404218 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4af286ec-8dfd-4108-b68e-9143b782bccb tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:34.404854 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-4af286ec-8dfd-4108-b68e-9143b782bccb tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:34.410917 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4af286ec-8dfd-4108-b68e-9143b782bccb tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:34.411354 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4af286ec-8dfd-4108-b68e-9143b782bccb tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:34.412112 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4af286ec-8dfd-4108-b68e-9143b782bccb tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:34.413111 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4af286ec-8dfd-4108-b68e-9143b782bccb tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:34.628926 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4af286ec-8dfd-4108-b68e-9143b782bccb tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:34.640183 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4af286ec-8dfd-4108-b68e-9143b782bccb tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.239687 Jun 27 15:48:34.643959 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-548d987f-32e9-44bc-ab93-db2ef962a680 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:34.651762 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 39/76] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:34 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:48:34.658027 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-548d987f-32e9-44bc-ab93-db2ef962a680 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.269332 Jun 27 15:48:34.658640 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 38/77] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:34 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:34.981366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-6cd12210-45cc-4421-8b31-7aab413ea124 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:34.982003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-6cd12210-45cc-4421-8b31-7aab413ea124 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:34.988092 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6cd12210-45cc-4421-8b31-7aab413ea124 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:34.988535 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6cd12210-45cc-4421-8b31-7aab413ea124 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:34.989294 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6cd12210-45cc-4421-8b31-7aab413ea124 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:34.989754 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6cd12210-45cc-4421-8b31-7aab413ea124 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:35.005139 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=100 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:48:35.119087 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-6cd12210-45cc-4421-8b31-7aab413ea124 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:35.126856 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-6cd12210-45cc-4421-8b31-7aab413ea124 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.149275 Jun 27 15:48:35.127434 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 40/78] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:34 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:35.658036 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-5077b25e-0171-45d2-987d-3962a0ae53a1 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:35.658633 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-5077b25e-0171-45d2-987d-3962a0ae53a1 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:35.665677 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5077b25e-0171-45d2-987d-3962a0ae53a1 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:35.666119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5077b25e-0171-45d2-987d-3962a0ae53a1 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:35.666870 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5077b25e-0171-45d2-987d-3962a0ae53a1 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:35.667296 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5077b25e-0171-45d2-987d-3962a0ae53a1 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:35.672054 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=100 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:48:35.675796 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d489131e-68a8-4009-8dde-363e1f81edbe tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:35.676406 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d489131e-68a8-4009-8dde-363e1f81edbe tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:35.683108 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d489131e-68a8-4009-8dde-363e1f81edbe tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:35.683558 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d489131e-68a8-4009-8dde-363e1f81edbe tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:35.684345 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d489131e-68a8-4009-8dde-363e1f81edbe tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:35.684776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d489131e-68a8-4009-8dde-363e1f81edbe tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:36.029260 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-5077b25e-0171-45d2-987d-3962a0ae53a1 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:36.034408 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d489131e-68a8-4009-8dde-363e1f81edbe tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:36.039620 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-5077b25e-0171-45d2-987d-3962a0ae53a1 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.385380 Jun 27 15:48:36.040210 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 39/79] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:35 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:36.043804 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d489131e-68a8-4009-8dde-363e1f81edbe tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.372239 Jun 27 15:48:36.044668 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 41/80] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:35 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:48:36.144789 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-bf667943-ddca-4092-9992-50068b9402fd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:36.145310 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-bf667943-ddca-4092-9992-50068b9402fd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:36.153020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bf667943-ddca-4092-9992-50068b9402fd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:36.153463 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bf667943-ddca-4092-9992-50068b9402fd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:36.154262 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bf667943-ddca-4092-9992-50068b9402fd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:36.154699 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bf667943-ddca-4092-9992-50068b9402fd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:36.287757 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-bf667943-ddca-4092-9992-50068b9402fd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:36.295269 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-bf667943-ddca-4092-9992-50068b9402fd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.154594 Jun 27 15:48:36.295832 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 40/81] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:36 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:37.057893 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-90f86ca9-f5a8-4c9b-9c5c-c6614f8ff310 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:37.058590 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-90f86ca9-f5a8-4c9b-9c5c-c6614f8ff310 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:37.062071 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-7ef17168-6d82-4c9a-93a7-7eeef3df3eab tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:37.062872 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-7ef17168-6d82-4c9a-93a7-7eeef3df3eab tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:37.065090 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-90f86ca9-f5a8-4c9b-9c5c-c6614f8ff310 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:37.065545 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-90f86ca9-f5a8-4c9b-9c5c-c6614f8ff310 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:37.066858 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-90f86ca9-f5a8-4c9b-9c5c-c6614f8ff310 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:37.067305 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-90f86ca9-f5a8-4c9b-9c5c-c6614f8ff310 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:37.069430 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7ef17168-6d82-4c9a-93a7-7eeef3df3eab tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:37.069914 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7ef17168-6d82-4c9a-93a7-7eeef3df3eab tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:37.070860 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7ef17168-6d82-4c9a-93a7-7eeef3df3eab tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:37.071294 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7ef17168-6d82-4c9a-93a7-7eeef3df3eab tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:37.269419 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-90f86ca9-f5a8-4c9b-9c5c-c6614f8ff310 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:37.274349 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-7ef17168-6d82-4c9a-93a7-7eeef3df3eab tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:37.278663 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-90f86ca9-f5a8-4c9b-9c5c-c6614f8ff310 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.225341 Jun 27 15:48:37.283816 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 42/82] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:37 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:37.286141 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-7ef17168-6d82-4c9a-93a7-7eeef3df3eab tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.227709 Jun 27 15:48:37.286793 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 41/83] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:37 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:48:37.312101 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-01528249-20c6-47e8-98f5-021162fc119b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:37.312700 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-01528249-20c6-47e8-98f5-021162fc119b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:37.319302 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-01528249-20c6-47e8-98f5-021162fc119b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:37.319745 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-01528249-20c6-47e8-98f5-021162fc119b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:37.320658 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-01528249-20c6-47e8-98f5-021162fc119b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:37.321089 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-01528249-20c6-47e8-98f5-021162fc119b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:37.452575 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-01528249-20c6-47e8-98f5-021162fc119b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:37.462069 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-01528249-20c6-47e8-98f5-021162fc119b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.153523 Jun 27 15:48:37.462664 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 43/84] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:37 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:38.296867 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c68fb02d-dcc2-462f-9cd2-1e30bdca52d0 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:38.297475 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c68fb02d-dcc2-462f-9cd2-1e30bdca52d0 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:38.304336 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a8dc3a28-2aa3-42fc-96ee-824359013c62 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:38.305540 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a8dc3a28-2aa3-42fc-96ee-824359013c62 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:38.307204 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c68fb02d-dcc2-462f-9cd2-1e30bdca52d0 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:38.308090 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c68fb02d-dcc2-462f-9cd2-1e30bdca52d0 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:38.309973 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c68fb02d-dcc2-462f-9cd2-1e30bdca52d0 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:38.310622 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c68fb02d-dcc2-462f-9cd2-1e30bdca52d0 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:38.315962 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a8dc3a28-2aa3-42fc-96ee-824359013c62 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:38.317750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a8dc3a28-2aa3-42fc-96ee-824359013c62 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:38.322561 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a8dc3a28-2aa3-42fc-96ee-824359013c62 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:38.323609 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a8dc3a28-2aa3-42fc-96ee-824359013c62 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:38.642335 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-c68fb02d-dcc2-462f-9cd2-1e30bdca52d0 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:38.657833 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c68fb02d-dcc2-462f-9cd2-1e30bdca52d0 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.365281 Jun 27 15:48:38.663560 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 42/85] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:38 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:38.681650 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9ed77b6e-c6c0-4ecb-85c7-ff417235afa5 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:38.682599 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9ed77b6e-c6c0-4ecb-85c7-ff417235afa5 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:38.691082 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9ed77b6e-c6c0-4ecb-85c7-ff417235afa5 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:38.693328 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9ed77b6e-c6c0-4ecb-85c7-ff417235afa5 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:38.694381 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9ed77b6e-c6c0-4ecb-85c7-ff417235afa5 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:38.695011 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9ed77b6e-c6c0-4ecb-85c7-ff417235afa5 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:38.756033 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a8dc3a28-2aa3-42fc-96ee-824359013c62 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:38.784973 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a8dc3a28-2aa3-42fc-96ee-824359013c62 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.485646 Jun 27 15:48:38.789079 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 44/86] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:38 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:48:38.969352 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9ed77b6e-c6c0-4ecb-85c7-ff417235afa5 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:38.986361 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9ed77b6e-c6c0-4ecb-85c7-ff417235afa5 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.307092 Jun 27 15:48:38.986986 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 43/87] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:38 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:39.507013 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-a75ca85c-f2a1-4925-ba60-59475885c346 req-492ecd33-5d32-43ef-9391-ffec75c47f68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "470a42f9-27c4-4ae0-958d-f3de3d434563", "tag": "917720a6-7efc-4170-b135-c693c95e0ee7"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:48:39.519598 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-a75ca85c-f2a1-4925-ba60-59475885c346 req-492ecd33-5d32-43ef-9391-ffec75c47f68 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:39.520041 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-a75ca85c-f2a1-4925-ba60-59475885c346 req-492ecd33-5d32-43ef-9391-ffec75c47f68 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:39.523778 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-6cba7c5f-c918-467b-ac7b-df8b98ddb980 req-8f84ba08-3684-4824-b981-1b95ad4a556c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1e27a3-c6e6-42ec-9a80-fa6806324aeb", "tag": "b6437b54-dcf4-4813-87ad-d62ddc232007"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:48:39.532515 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-6cba7c5f-c918-467b-ac7b-df8b98ddb980 req-8f84ba08-3684-4824-b981-1b95ad4a556c service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:39.533131 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-6cba7c5f-c918-467b-ac7b-df8b98ddb980 req-8f84ba08-3684-4824-b981-1b95ad4a556c service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:39.543595 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-a75ca85c-f2a1-4925-ba60-59475885c346 req-492ecd33-5d32-43ef-9391-ffec75c47f68 service nova] Creating event network-changed:917720a6-7efc-4170-b135-c693c95e0ee7 for instance 470a42f9-27c4-4ae0-958d-f3de3d434563 on hv-cinder-84780 Jun 27 15:48:39.544120 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-a75ca85c-f2a1-4925-ba60-59475885c346 req-492ecd33-5d32-43ef-9391-ffec75c47f68 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129473) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 27 15:48:39.545265 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c12161f6-dd85-41f8-bc37-a45cb8bec197 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:39.545738 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c12161f6-dd85-41f8-bc37-a45cb8bec197 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:39.546752 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-6cba7c5f-c918-467b-ac7b-df8b98ddb980 req-8f84ba08-3684-4824-b981-1b95ad4a556c service nova] Creating event network-changed:b6437b54-dcf4-4813-87ad-d62ddc232007 for instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb on hv-cinder-84780 Jun 27 15:48:39.546881 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c12161f6-dd85-41f8-bc37-a45cb8bec197 None None] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:39.547198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c12161f6-dd85-41f8-bc37-a45cb8bec197 None None] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:39.552248 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-6cba7c5f-c918-467b-ac7b-df8b98ddb980 req-8f84ba08-3684-4824-b981-1b95ad4a556c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033601 Jun 27 15:48:39.553280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 44/88] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:48:39.558686 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.compute.rpcapi [None req-c12161f6-dd85-41f8-bc37-a45cb8bec197 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 27 15:48:39.559602 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c12161f6-dd85-41f8-bc37-a45cb8bec197 None None] Releasing lock "compute-rpcapi-router" {{(pid=129473) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 27 15:48:39.576251 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c12161f6-dd85-41f8-bc37-a45cb8bec197 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138878 Jun 27 15:48:39.577097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 45/89] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:48:39.681079 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-bf1d0e30-799a-42f3-8caa-51df323958d6 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:39.681926 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-bf1d0e30-799a-42f3-8caa-51df323958d6 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:39.689287 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bf1d0e30-799a-42f3-8caa-51df323958d6 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:39.689768 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bf1d0e30-799a-42f3-8caa-51df323958d6 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:39.690541 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bf1d0e30-799a-42f3-8caa-51df323958d6 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:39.690977 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bf1d0e30-799a-42f3-8caa-51df323958d6 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:39.805854 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3c8f81ce-dd24-4f8d-93e1-5f0f89cc8eae tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:39.806555 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3c8f81ce-dd24-4f8d-93e1-5f0f89cc8eae tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:39.812878 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3c8f81ce-dd24-4f8d-93e1-5f0f89cc8eae tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:39.813327 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3c8f81ce-dd24-4f8d-93e1-5f0f89cc8eae tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:39.814123 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3c8f81ce-dd24-4f8d-93e1-5f0f89cc8eae tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:39.814558 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3c8f81ce-dd24-4f8d-93e1-5f0f89cc8eae tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:39.838741 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-bf1d0e30-799a-42f3-8caa-51df323958d6 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:39.847700 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-bf1d0e30-799a-42f3-8caa-51df323958d6 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.170875 Jun 27 15:48:39.848393 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 45/90] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:39 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:39.952149 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3c8f81ce-dd24-4f8d-93e1-5f0f89cc8eae tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:39.959765 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3c8f81ce-dd24-4f8d-93e1-5f0f89cc8eae tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.159274 Jun 27 15:48:39.960326 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 46/91] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:39 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:48:40.003844 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-42085570-67c2-44b7-ad59-11edded2bb02 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:40.004425 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-42085570-67c2-44b7-ad59-11edded2bb02 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:40.010571 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-42085570-67c2-44b7-ad59-11edded2bb02 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:40.011011 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-42085570-67c2-44b7-ad59-11edded2bb02 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:40.011760 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-42085570-67c2-44b7-ad59-11edded2bb02 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:40.012185 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-42085570-67c2-44b7-ad59-11edded2bb02 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:40.148659 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-42085570-67c2-44b7-ad59-11edded2bb02 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:40.156214 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-42085570-67c2-44b7-ad59-11edded2bb02 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.156155 Jun 27 15:48:40.156779 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 46/92] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:39 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:40.866673 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a5f8b0fa-a664-4b6c-96bb-9835938a1742 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:40.867378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a5f8b0fa-a664-4b6c-96bb-9835938a1742 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:40.880325 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a5f8b0fa-a664-4b6c-96bb-9835938a1742 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:40.880809 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a5f8b0fa-a664-4b6c-96bb-9835938a1742 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:40.881687 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a5f8b0fa-a664-4b6c-96bb-9835938a1742 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:40.882124 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a5f8b0fa-a664-4b6c-96bb-9835938a1742 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:40.976923 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-2a92c18e-d18d-49db-bfa6-6f7c4fb53a06 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:40.977670 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-2a92c18e-d18d-49db-bfa6-6f7c4fb53a06 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:40.984088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2a92c18e-d18d-49db-bfa6-6f7c4fb53a06 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:40.984618 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2a92c18e-d18d-49db-bfa6-6f7c4fb53a06 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:40.985458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2a92c18e-d18d-49db-bfa6-6f7c4fb53a06 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:40.985936 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2a92c18e-d18d-49db-bfa6-6f7c4fb53a06 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:41.014628 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a5f8b0fa-a664-4b6c-96bb-9835938a1742 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:41.022892 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a5f8b0fa-a664-4b6c-96bb-9835938a1742 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.160603 Jun 27 15:48:41.023396 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 47/93] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:40 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:48:41.115612 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-2a92c18e-d18d-49db-bfa6-6f7c4fb53a06 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:41.123416 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-2a92c18e-d18d-49db-bfa6-6f7c4fb53a06 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.150923 Jun 27 15:48:41.124012 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 47/94] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:40 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:48:41.173766 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-79bd6e6d-10e4-40c6-a9fc-f749864b6ccb tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:41.174518 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-79bd6e6d-10e4-40c6-a9fc-f749864b6ccb tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:41.180741 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-79bd6e6d-10e4-40c6-a9fc-f749864b6ccb tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:41.181418 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-79bd6e6d-10e4-40c6-a9fc-f749864b6ccb tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:41.182640 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-79bd6e6d-10e4-40c6-a9fc-f749864b6ccb tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:41.183872 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-79bd6e6d-10e4-40c6-a9fc-f749864b6ccb tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:41.500388 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-79bd6e6d-10e4-40c6-a9fc-f749864b6ccb tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:41.515474 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-79bd6e6d-10e4-40c6-a9fc-f749864b6ccb tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.345704 Jun 27 15:48:41.517430 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 48/95] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:41 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:42.039973 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-81cbda1f-6553-4a6a-aa13-c2350c3d7abe tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:42.040573 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-81cbda1f-6553-4a6a-aa13-c2350c3d7abe tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:42.047062 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81cbda1f-6553-4a6a-aa13-c2350c3d7abe tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:42.047971 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81cbda1f-6553-4a6a-aa13-c2350c3d7abe tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:42.048749 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81cbda1f-6553-4a6a-aa13-c2350c3d7abe tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:42.049177 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81cbda1f-6553-4a6a-aa13-c2350c3d7abe tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:42.141162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-46429abf-cfc8-47f1-bec5-922261c5d267 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:42.141804 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-46429abf-cfc8-47f1-bec5-922261c5d267 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:42.148018 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-46429abf-cfc8-47f1-bec5-922261c5d267 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:42.148471 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-46429abf-cfc8-47f1-bec5-922261c5d267 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:42.149229 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-46429abf-cfc8-47f1-bec5-922261c5d267 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:42.149672 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-46429abf-cfc8-47f1-bec5-922261c5d267 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:42.204585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-81cbda1f-6553-4a6a-aa13-c2350c3d7abe tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:42.213720 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-81cbda1f-6553-4a6a-aa13-c2350c3d7abe tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.176374 Jun 27 15:48:42.213720 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 48/96] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:42 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:42.294288 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-46429abf-cfc8-47f1-bec5-922261c5d267 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:42.301940 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-46429abf-cfc8-47f1-bec5-922261c5d267 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.165343 Jun 27 15:48:42.302500 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 49/97] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:42 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:48:42.532593 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a3ec7811-febd-487c-b82d-d680d0b52311 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:42.533202 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a3ec7811-febd-487c-b82d-d680d0b52311 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:42.539411 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a3ec7811-febd-487c-b82d-d680d0b52311 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:42.539793 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a3ec7811-febd-487c-b82d-d680d0b52311 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:42.540557 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a3ec7811-febd-487c-b82d-d680d0b52311 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:42.540991 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a3ec7811-febd-487c-b82d-d680d0b52311 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:42.672050 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a3ec7811-febd-487c-b82d-d680d0b52311 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:42.679984 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-a3ec7811-febd-487c-b82d-d680d0b52311 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.151292 Jun 27 15:48:42.680553 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 49/98] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:42 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:43.228344 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3b438078-29f6-4173-98ac-c8a82bb1628d tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:43.228948 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3b438078-29f6-4173-98ac-c8a82bb1628d tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:43.235061 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3b438078-29f6-4173-98ac-c8a82bb1628d tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:43.235501 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3b438078-29f6-4173-98ac-c8a82bb1628d tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:43.236248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3b438078-29f6-4173-98ac-c8a82bb1628d tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:43.236673 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3b438078-29f6-4173-98ac-c8a82bb1628d tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:43.321229 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9685d886-79c8-4e2c-a137-5460b75268e6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:43.323015 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9685d886-79c8-4e2c-a137-5460b75268e6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:43.329685 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9685d886-79c8-4e2c-a137-5460b75268e6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:43.330131 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9685d886-79c8-4e2c-a137-5460b75268e6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:43.330908 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9685d886-79c8-4e2c-a137-5460b75268e6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:43.331379 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9685d886-79c8-4e2c-a137-5460b75268e6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:43.413334 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3b438078-29f6-4173-98ac-c8a82bb1628d tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:43.420770 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3b438078-29f6-4173-98ac-c8a82bb1628d tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.196315 Jun 27 15:48:43.421600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 50/99] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:43 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:43.475775 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9685d886-79c8-4e2c-a137-5460b75268e6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:43.483246 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9685d886-79c8-4e2c-a137-5460b75268e6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.167938 Jun 27 15:48:43.483814 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 50/100] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:43 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:48:43.697106 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e3c3fa63-e87d-4a04-afbe-c8e9c3888ae7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:43.697841 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e3c3fa63-e87d-4a04-afbe-c8e9c3888ae7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:43.704221 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e3c3fa63-e87d-4a04-afbe-c8e9c3888ae7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:43.704679 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e3c3fa63-e87d-4a04-afbe-c8e9c3888ae7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:43.705455 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e3c3fa63-e87d-4a04-afbe-c8e9c3888ae7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:43.705930 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e3c3fa63-e87d-4a04-afbe-c8e9c3888ae7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:43.839109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e3c3fa63-e87d-4a04-afbe-c8e9c3888ae7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:43.846619 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e3c3fa63-e87d-4a04-afbe-c8e9c3888ae7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.154190 Jun 27 15:48:43.847181 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 51/101] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:43 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:44.441199 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-7f74dbda-7025-4073-9c62-87986e4d30ec tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:44.442471 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-7f74dbda-7025-4073-9c62-87986e4d30ec tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:44.451044 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7f74dbda-7025-4073-9c62-87986e4d30ec tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:44.452293 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7f74dbda-7025-4073-9c62-87986e4d30ec tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:44.453786 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7f74dbda-7025-4073-9c62-87986e4d30ec tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:44.454376 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7f74dbda-7025-4073-9c62-87986e4d30ec tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:44.499273 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-6fdd4913-91e4-4545-9c13-308dad905ffa tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:44.499944 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-6fdd4913-91e4-4545-9c13-308dad905ffa tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:44.507066 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6fdd4913-91e4-4545-9c13-308dad905ffa tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:44.507811 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6fdd4913-91e4-4545-9c13-308dad905ffa tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:44.508777 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6fdd4913-91e4-4545-9c13-308dad905ffa tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:44.509464 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6fdd4913-91e4-4545-9c13-308dad905ffa tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:44.673116 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-7f74dbda-7025-4073-9c62-87986e4d30ec tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:44.682381 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-7f74dbda-7025-4073-9c62-87986e4d30ec tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.247349 Jun 27 15:48:44.683020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 51/102] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:44 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:44.703170 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-6fdd4913-91e4-4545-9c13-308dad905ffa tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:44.711226 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-6fdd4913-91e4-4545-9c13-308dad905ffa tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.215893 Jun 27 15:48:44.711784 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 52/103] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:44 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:44.869301 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-0f52992e-231d-4026-83a9-bda8c5db4758 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:44.869993 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-0f52992e-231d-4026-83a9-bda8c5db4758 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:44.876155 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0f52992e-231d-4026-83a9-bda8c5db4758 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:44.876672 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0f52992e-231d-4026-83a9-bda8c5db4758 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:44.877367 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0f52992e-231d-4026-83a9-bda8c5db4758 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:44.877899 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0f52992e-231d-4026-83a9-bda8c5db4758 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:45.025460 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0f52992e-231d-4026-83a9-bda8c5db4758 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:45.034051 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-0f52992e-231d-4026-83a9-bda8c5db4758 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.173596 Jun 27 15:48:45.034642 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 52/104] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:44 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:45.701666 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-fb368b2c-5e11-48d1-ae63-945fd5d86819 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:45.703907 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-fb368b2c-5e11-48d1-ae63-945fd5d86819 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:45.721413 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fb368b2c-5e11-48d1-ae63-945fd5d86819 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:45.722155 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fb368b2c-5e11-48d1-ae63-945fd5d86819 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:45.731532 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-150a43fb-38c9-4543-9f08-3693214049cf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:45.733447 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-150a43fb-38c9-4543-9f08-3693214049cf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:45.738352 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fb368b2c-5e11-48d1-ae63-945fd5d86819 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:45.739927 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fb368b2c-5e11-48d1-ae63-945fd5d86819 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:45.750713 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-150a43fb-38c9-4543-9f08-3693214049cf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:45.751601 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-150a43fb-38c9-4543-9f08-3693214049cf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:45.754063 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-150a43fb-38c9-4543-9f08-3693214049cf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:45.757564 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-150a43fb-38c9-4543-9f08-3693214049cf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:46.041256 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-fb368b2c-5e11-48d1-ae63-945fd5d86819 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:46.041470 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-150a43fb-38c9-4543-9f08-3693214049cf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:46.052935 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-fb368b2c-5e11-48d1-ae63-945fd5d86819 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.355408 Jun 27 15:48:46.053680 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 53/105] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:45 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:46.056497 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-150a43fb-38c9-4543-9f08-3693214049cf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.331369 Jun 27 15:48:46.059669 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-11f94850-aebe-4566-af42-c1d7eae36d0e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:46.060266 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-11f94850-aebe-4566-af42-c1d7eae36d0e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:46.063277 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 53/106] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:45 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:46.067040 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-11f94850-aebe-4566-af42-c1d7eae36d0e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:46.067557 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-11f94850-aebe-4566-af42-c1d7eae36d0e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:46.069074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-11f94850-aebe-4566-af42-c1d7eae36d0e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:46.069828 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-11f94850-aebe-4566-af42-c1d7eae36d0e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:46.283605 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-11f94850-aebe-4566-af42-c1d7eae36d0e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:46.294908 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-11f94850-aebe-4566-af42-c1d7eae36d0e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.239444 Jun 27 15:48:46.296598 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 54/107] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:46 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:47.070309 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-e5f13b9c-41aa-4925-addc-0567db764f2c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:47.070909 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-e5f13b9c-41aa-4925-addc-0567db764f2c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:47.071944 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f7fe186b-2532-4a0d-b579-cc73d7c9f77f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:47.072564 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f7fe186b-2532-4a0d-b579-cc73d7c9f77f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:47.077074 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e5f13b9c-41aa-4925-addc-0567db764f2c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:47.077763 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e5f13b9c-41aa-4925-addc-0567db764f2c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:47.078497 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f7fe186b-2532-4a0d-b579-cc73d7c9f77f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:47.078849 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e5f13b9c-41aa-4925-addc-0567db764f2c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:47.078965 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f7fe186b-2532-4a0d-b579-cc73d7c9f77f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:47.079527 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e5f13b9c-41aa-4925-addc-0567db764f2c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:47.079703 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f7fe186b-2532-4a0d-b579-cc73d7c9f77f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:47.080131 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f7fe186b-2532-4a0d-b579-cc73d7c9f77f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:47.284516 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-e5f13b9c-41aa-4925-addc-0567db764f2c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:47.286518 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f7fe186b-2532-4a0d-b579-cc73d7c9f77f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:47.296825 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-e5f13b9c-41aa-4925-addc-0567db764f2c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.230281 Jun 27 15:48:47.297383 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 54/108] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:47 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:47.304977 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f7fe186b-2532-4a0d-b579-cc73d7c9f77f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.236659 Jun 27 15:48:47.307097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 55/109] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:47 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:48:47.312272 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-fdf213a6-9634-4f04-aef1-3ed67787b16c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:47.312873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-fdf213a6-9634-4f04-aef1-3ed67787b16c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:47.319642 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fdf213a6-9634-4f04-aef1-3ed67787b16c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:47.320083 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fdf213a6-9634-4f04-aef1-3ed67787b16c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:47.320845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fdf213a6-9634-4f04-aef1-3ed67787b16c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:47.321306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fdf213a6-9634-4f04-aef1-3ed67787b16c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:47.454088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-fdf213a6-9634-4f04-aef1-3ed67787b16c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:47.463216 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-fdf213a6-9634-4f04-aef1-3ed67787b16c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.154665 Jun 27 15:48:47.463794 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 55/110] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:47 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:48.314713 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-34117c58-aa87-4553-a7ca-a892f5828c81 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:48.315314 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-34117c58-aa87-4553-a7ca-a892f5828c81 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:48.322371 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-34117c58-aa87-4553-a7ca-a892f5828c81 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:48.322832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-34117c58-aa87-4553-a7ca-a892f5828c81 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:48.323814 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-34117c58-aa87-4553-a7ca-a892f5828c81 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:48.324771 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-34117c58-aa87-4553-a7ca-a892f5828c81 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:48.325295 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c03a329a-3535-4f7b-b064-b7a7b3c06522 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:48.326078 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c03a329a-3535-4f7b-b064-b7a7b3c06522 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:48.332324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c03a329a-3535-4f7b-b064-b7a7b3c06522 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:48.332775 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c03a329a-3535-4f7b-b064-b7a7b3c06522 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:48.333586 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c03a329a-3535-4f7b-b064-b7a7b3c06522 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:48.334596 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c03a329a-3535-4f7b-b064-b7a7b3c06522 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:48.359731 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=100 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:48:48.539738 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-34117c58-aa87-4553-a7ca-a892f5828c81 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:48.552050 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-34117c58-aa87-4553-a7ca-a892f5828c81 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.241409 Jun 27 15:48:48.557002 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-c03a329a-3535-4f7b-b064-b7a7b3c06522 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:48.560225 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 56/111] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:48 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:48.565089 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-628566b2-d90b-444b-a550-82fd578c7e51 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:48.565713 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-628566b2-d90b-444b-a550-82fd578c7e51 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:48.573608 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c03a329a-3535-4f7b-b064-b7a7b3c06522 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.253194 Jun 27 15:48:48.574215 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 56/112] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:48 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:48.577540 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-628566b2-d90b-444b-a550-82fd578c7e51 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:48.578020 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-628566b2-d90b-444b-a550-82fd578c7e51 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:48.578794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-628566b2-d90b-444b-a550-82fd578c7e51 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:48.579230 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-628566b2-d90b-444b-a550-82fd578c7e51 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:48.594785 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=100 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:48:48.716468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-628566b2-d90b-444b-a550-82fd578c7e51 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:48.724269 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-628566b2-d90b-444b-a550-82fd578c7e51 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.162844 Jun 27 15:48:48.726155 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 57/113] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:48 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:49.569541 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f9f73831-38bc-4d31-85eb-73efdceb97dc tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:49.570240 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f9f73831-38bc-4d31-85eb-73efdceb97dc tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:49.576492 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f9f73831-38bc-4d31-85eb-73efdceb97dc tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:49.576943 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f9f73831-38bc-4d31-85eb-73efdceb97dc tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:49.577750 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f9f73831-38bc-4d31-85eb-73efdceb97dc tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:49.578188 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f9f73831-38bc-4d31-85eb-73efdceb97dc tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:49.590636 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4a39fef9-ba89-42ce-8ec5-ba1e3f45720d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:49.591395 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-4a39fef9-ba89-42ce-8ec5-ba1e3f45720d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:49.593513 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=2 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:48:49.600824 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4a39fef9-ba89-42ce-8ec5-ba1e3f45720d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:49.601372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4a39fef9-ba89-42ce-8ec5-ba1e3f45720d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:49.602446 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4a39fef9-ba89-42ce-8ec5-ba1e3f45720d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:49.602982 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4a39fef9-ba89-42ce-8ec5-ba1e3f45720d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:49.799341 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f9f73831-38bc-4d31-85eb-73efdceb97dc tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:49.803774 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4a39fef9-ba89-42ce-8ec5-ba1e3f45720d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:49.810899 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f9f73831-38bc-4d31-85eb-73efdceb97dc tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.245292 Jun 27 15:48:49.811484 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 57/114] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:49 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:49.811627 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4a39fef9-ba89-42ce-8ec5-ba1e3f45720d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.224858 Jun 27 15:48:49.812387 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 58/115] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:49 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:49.824962 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-984040cc-d355-4831-9bbf-9f1f000a88df tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:49.825975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-984040cc-d355-4831-9bbf-9f1f000a88df tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:49.832405 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-984040cc-d355-4831-9bbf-9f1f000a88df tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:49.832858 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-984040cc-d355-4831-9bbf-9f1f000a88df tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:49.833629 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-984040cc-d355-4831-9bbf-9f1f000a88df tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:49.834568 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-984040cc-d355-4831-9bbf-9f1f000a88df tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:49.890998 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-769f1f02-f6cb-4c15-b517-2ac2961d2f1d req-84bb770e-7265-422e-bbbc-64f282933f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4fbc86-ac2c-4bda-b073-02c52f0559f1", "name": "network-vif-plugged", "status": "completed", "tag": "8c661832-e9de-45b0-be49-833df2b9cc70"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:48:49.903554 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-769f1f02-f6cb-4c15-b517-2ac2961d2f1d req-84bb770e-7265-422e-bbbc-64f282933f5c service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:49.904007 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-769f1f02-f6cb-4c15-b517-2ac2961d2f1d req-84bb770e-7265-422e-bbbc-64f282933f5c service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:49.917474 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-769f1f02-f6cb-4c15-b517-2ac2961d2f1d req-84bb770e-7265-422e-bbbc-64f282933f5c service nova] Creating event network-vif-plugged:8c661832-e9de-45b0-be49-833df2b9cc70 for instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 on hv-cinder-84780 Jun 27 15:48:49.924419 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-769f1f02-f6cb-4c15-b517-2ac2961d2f1d req-84bb770e-7265-422e-bbbc-64f282933f5c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110832 Jun 27 15:48:49.925576 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 59/116] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:48:49.986583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-984040cc-d355-4831-9bbf-9f1f000a88df tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:49.996830 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-984040cc-d355-4831-9bbf-9f1f000a88df tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.183926 Jun 27 15:48:49.997436 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 58/117] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:49 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:50.832096 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-0ddae96c-0c16-472d-afa5-fe63fa67b6ae tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:50.832631 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-1fc6e82e-ee1e-44b1-a34b-dc77dae5eaa8 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:50.833564 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-1fc6e82e-ee1e-44b1-a34b-dc77dae5eaa8 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:50.834933 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-0ddae96c-0c16-472d-afa5-fe63fa67b6ae tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:50.843192 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1fc6e82e-ee1e-44b1-a34b-dc77dae5eaa8 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:50.843822 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1fc6e82e-ee1e-44b1-a34b-dc77dae5eaa8 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:50.844420 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1fc6e82e-ee1e-44b1-a34b-dc77dae5eaa8 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:50.844728 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0ddae96c-0c16-472d-afa5-fe63fa67b6ae tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:50.844861 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1fc6e82e-ee1e-44b1-a34b-dc77dae5eaa8 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:50.845769 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0ddae96c-0c16-472d-afa5-fe63fa67b6ae tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:50.846761 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0ddae96c-0c16-472d-afa5-fe63fa67b6ae tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:50.847211 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0ddae96c-0c16-472d-afa5-fe63fa67b6ae tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:51.079597 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0ddae96c-0c16-472d-afa5-fe63fa67b6ae tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:51.083359 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-1fc6e82e-ee1e-44b1-a34b-dc77dae5eaa8 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:51.087959 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-0ddae96c-0c16-472d-afa5-fe63fa67b6ae tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.261022 Jun 27 15:48:51.091382 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 59/118] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:50 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:51.096108 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-89a5a7c7-6ff9-4fe4-a879-b1b6d631ca20 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:51.100447 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-89a5a7c7-6ff9-4fe4-a879-b1b6d631ca20 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:51.104174 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-1fc6e82e-ee1e-44b1-a34b-dc77dae5eaa8 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.276207 Jun 27 15:48:51.104619 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 60/119] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:50 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:51.120183 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-89a5a7c7-6ff9-4fe4-a879-b1b6d631ca20 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:51.121931 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-89a5a7c7-6ff9-4fe4-a879-b1b6d631ca20 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:51.123872 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-89a5a7c7-6ff9-4fe4-a879-b1b6d631ca20 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:51.125092 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-89a5a7c7-6ff9-4fe4-a879-b1b6d631ca20 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:51.323616 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-89a5a7c7-6ff9-4fe4-a879-b1b6d631ca20 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:51.333777 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-89a5a7c7-6ff9-4fe4-a879-b1b6d631ca20 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.240787 Jun 27 15:48:51.334061 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 60/120] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:51 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:51.941547 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-fe626d95-ab75-493a-85ce-d4bd4390b5a9 req-d8546e53-c14f-4dd1-8a39-87192db2b0a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5", "name": "network-vif-plugged", "status": "completed", "tag": "db62c7bb-5168-441d-a55f-cb931ba441a4"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:48:51.950548 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-fe626d95-ab75-493a-85ce-d4bd4390b5a9 req-d8546e53-c14f-4dd1-8a39-87192db2b0a3 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:51.951170 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-fe626d95-ab75-493a-85ce-d4bd4390b5a9 req-d8546e53-c14f-4dd1-8a39-87192db2b0a3 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:51.965195 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-fe626d95-ab75-493a-85ce-d4bd4390b5a9 req-d8546e53-c14f-4dd1-8a39-87192db2b0a3 service nova] Creating event network-vif-plugged:db62c7bb-5168-441d-a55f-cb931ba441a4 for instance 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 on hv-cinder-84780 Jun 27 15:48:51.972414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-fe626d95-ab75-493a-85ce-d4bd4390b5a9 req-d8546e53-c14f-4dd1-8a39-87192db2b0a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033890 Jun 27 15:48:51.977512 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 61/121] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:48:52.109026 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-78a3a028-2a13-4bda-aff1-aecac58ef92a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:52.109676 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-78a3a028-2a13-4bda-aff1-aecac58ef92a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:52.121501 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-635e5780-abe5-4886-bf07-b4e1fd44a3ae tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:52.122969 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-635e5780-abe5-4886-bf07-b4e1fd44a3ae tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:52.133491 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-78a3a028-2a13-4bda-aff1-aecac58ef92a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:52.133978 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-78a3a028-2a13-4bda-aff1-aecac58ef92a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:52.136556 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-635e5780-abe5-4886-bf07-b4e1fd44a3ae tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:52.137564 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-78a3a028-2a13-4bda-aff1-aecac58ef92a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:52.138321 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-635e5780-abe5-4886-bf07-b4e1fd44a3ae tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:52.139110 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-635e5780-abe5-4886-bf07-b4e1fd44a3ae tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:52.139547 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-635e5780-abe5-4886-bf07-b4e1fd44a3ae tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:52.140407 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-78a3a028-2a13-4bda-aff1-aecac58ef92a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:52.396144 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-635e5780-abe5-4886-bf07-b4e1fd44a3ae tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:52.404829 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-635e5780-abe5-4886-bf07-b4e1fd44a3ae tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.287485 Jun 27 15:48:52.405703 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 62/122] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:52 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:48:52.410432 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-afcd12a8-b3b0-46c0-82b1-c501209b3bc5 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:52.411306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-afcd12a8-b3b0-46c0-82b1-c501209b3bc5 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:52.411414 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-78a3a028-2a13-4bda-aff1-aecac58ef92a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:52.413911 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:48:52.420364 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-afcd12a8-b3b0-46c0-82b1-c501209b3bc5 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:52.421548 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-afcd12a8-b3b0-46c0-82b1-c501209b3bc5 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:52.422839 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-afcd12a8-b3b0-46c0-82b1-c501209b3bc5 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:52.423722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-afcd12a8-b3b0-46c0-82b1-c501209b3bc5 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:52.425163 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-78a3a028-2a13-4bda-aff1-aecac58ef92a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.319938 Jun 27 15:48:52.432711 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 61/123] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:52 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:52.574253 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-afcd12a8-b3b0-46c0-82b1-c501209b3bc5 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:52.582361 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-afcd12a8-b3b0-46c0-82b1-c501209b3bc5 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.175457 Jun 27 15:48:52.583038 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 63/124] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:52 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:53.423079 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3ebb66c5-bebc-422d-b75f-01c320290d09 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:53.423966 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3ebb66c5-bebc-422d-b75f-01c320290d09 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:53.431513 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3ebb66c5-bebc-422d-b75f-01c320290d09 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:53.432649 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3ebb66c5-bebc-422d-b75f-01c320290d09 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:53.433658 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3ebb66c5-bebc-422d-b75f-01c320290d09 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:53.434260 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3ebb66c5-bebc-422d-b75f-01c320290d09 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:53.445127 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-515a565b-7647-4dfe-a415-d07b0fa9e37e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:53.447899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-515a565b-7647-4dfe-a415-d07b0fa9e37e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:53.459285 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-515a565b-7647-4dfe-a415-d07b0fa9e37e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:53.460080 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-515a565b-7647-4dfe-a415-d07b0fa9e37e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:53.461183 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-515a565b-7647-4dfe-a415-d07b0fa9e37e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:53.461978 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-515a565b-7647-4dfe-a415-d07b0fa9e37e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:53.684885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3ebb66c5-bebc-422d-b75f-01c320290d09 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:53.694757 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3ebb66c5-bebc-422d-b75f-01c320290d09 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.276694 Jun 27 15:48:53.697877 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 62/125] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:53 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:53.710402 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-7fc15788-8470-47fd-b89c-2234701528b6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:53.711224 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-7fc15788-8470-47fd-b89c-2234701528b6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:53.718076 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7fc15788-8470-47fd-b89c-2234701528b6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:53.718719 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7fc15788-8470-47fd-b89c-2234701528b6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:53.718832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-515a565b-7647-4dfe-a415-d07b0fa9e37e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:53.719722 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7fc15788-8470-47fd-b89c-2234701528b6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:53.720308 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7fc15788-8470-47fd-b89c-2234701528b6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:53.726982 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-515a565b-7647-4dfe-a415-d07b0fa9e37e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.288489 Jun 27 15:48:53.737849 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 64/126] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:53 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:53.885049 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-7fc15788-8470-47fd-b89c-2234701528b6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:53.892968 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-7fc15788-8470-47fd-b89c-2234701528b6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.193606 Jun 27 15:48:53.893535 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 63/127] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:53 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:54.714776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4be31a45-4109-4edc-9cd2-0804a8732ffb tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:54.716002 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-4be31a45-4109-4edc-9cd2-0804a8732ffb tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:54.722472 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4be31a45-4109-4edc-9cd2-0804a8732ffb tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:54.723151 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4be31a45-4109-4edc-9cd2-0804a8732ffb tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:54.724144 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4be31a45-4109-4edc-9cd2-0804a8732ffb tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:54.725363 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4be31a45-4109-4edc-9cd2-0804a8732ffb tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:54.744672 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9db3fce5-754a-45c0-b5a4-4cc459e31ec1 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:54.745405 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9db3fce5-754a-45c0-b5a4-4cc459e31ec1 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:54.752439 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9db3fce5-754a-45c0-b5a4-4cc459e31ec1 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:54.754181 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9db3fce5-754a-45c0-b5a4-4cc459e31ec1 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:54.758221 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9db3fce5-754a-45c0-b5a4-4cc459e31ec1 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:54.758877 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9db3fce5-754a-45c0-b5a4-4cc459e31ec1 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:55.113453 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4be31a45-4109-4edc-9cd2-0804a8732ffb tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:55.115510 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9db3fce5-754a-45c0-b5a4-4cc459e31ec1 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:55.124808 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9db3fce5-754a-45c0-b5a4-4cc459e31ec1 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.384211 Jun 27 15:48:55.125739 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 64/128] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:54 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:48:55.126511 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4be31a45-4109-4edc-9cd2-0804a8732ffb tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1314 microversion: 2.1 time: 0.414957 Jun 27 15:48:55.127335 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 65/129] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:54 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:55.147943 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-6f5fdd52-f2ac-4fed-a22e-d329ce9de0cb tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:55.153365 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-6f5fdd52-f2ac-4fed-a22e-d329ce9de0cb tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:55.169123 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6f5fdd52-f2ac-4fed-a22e-d329ce9de0cb tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:55.171811 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6f5fdd52-f2ac-4fed-a22e-d329ce9de0cb tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:55.172879 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6f5fdd52-f2ac-4fed-a22e-d329ce9de0cb tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:55.173317 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6f5fdd52-f2ac-4fed-a22e-d329ce9de0cb tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:55.489551 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-6f5fdd52-f2ac-4fed-a22e-d329ce9de0cb tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:55.510689 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-6f5fdd52-f2ac-4fed-a22e-d329ce9de0cb tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.383784 Jun 27 15:48:55.522574 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 65/130] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:55 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:55.561255 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-3e5df2f9-808c-49fc-8680-0c7dc3295c0b req-bcc0754d-e062-4e53-bbd1-9ab2da1ffa0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "470a42f9-27c4-4ae0-958d-f3de3d434563", "name": "network-vif-plugged", "status": "completed", "tag": "917720a6-7efc-4170-b135-c693c95e0ee7"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:48:55.575803 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-3e5df2f9-808c-49fc-8680-0c7dc3295c0b req-bcc0754d-e062-4e53-bbd1-9ab2da1ffa0d service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:55.578239 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-3e5df2f9-808c-49fc-8680-0c7dc3295c0b req-bcc0754d-e062-4e53-bbd1-9ab2da1ffa0d service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:55.611896 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-3e5df2f9-808c-49fc-8680-0c7dc3295c0b req-bcc0754d-e062-4e53-bbd1-9ab2da1ffa0d service nova] Creating event network-vif-plugged:917720a6-7efc-4170-b135-c693c95e0ee7 for instance 470a42f9-27c4-4ae0-958d-f3de3d434563 on hv-cinder-84780 Jun 27 15:48:55.626843 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-3e5df2f9-808c-49fc-8680-0c7dc3295c0b req-bcc0754d-e062-4e53-bbd1-9ab2da1ffa0d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067031 Jun 27 15:48:55.631262 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 66/131] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:48:56.144554 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-226cfb31-a5f3-484c-8416-ea8f75d6eac8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:56.145921 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-226cfb31-a5f3-484c-8416-ea8f75d6eac8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:56.151704 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-9ab9bd5e-7b84-41db-a374-0d564e933ad3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:56.152449 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-9ab9bd5e-7b84-41db-a374-0d564e933ad3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:56.158974 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-226cfb31-a5f3-484c-8416-ea8f75d6eac8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:56.160121 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9ab9bd5e-7b84-41db-a374-0d564e933ad3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:56.160790 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-226cfb31-a5f3-484c-8416-ea8f75d6eac8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:56.164860 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-226cfb31-a5f3-484c-8416-ea8f75d6eac8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:56.165394 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-226cfb31-a5f3-484c-8416-ea8f75d6eac8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:56.165793 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9ab9bd5e-7b84-41db-a374-0d564e933ad3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:56.166726 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9ab9bd5e-7b84-41db-a374-0d564e933ad3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:56.167176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9ab9bd5e-7b84-41db-a374-0d564e933ad3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:56.402474 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-226cfb31-a5f3-484c-8416-ea8f75d6eac8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:56.410566 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-226cfb31-a5f3-484c-8416-ea8f75d6eac8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.271198 Jun 27 15:48:56.413125 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 66/132] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:56 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:56.421756 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-9ab9bd5e-7b84-41db-a374-0d564e933ad3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:56.431508 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-9ab9bd5e-7b84-41db-a374-0d564e933ad3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1501 microversion: 2.1 time: 0.283991 Jun 27 15:48:56.432092 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 67/133] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:56 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1501 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:56.528957 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-bccffff7-e557-4f27-a5b7-6b43f5dfd767 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:56.529921 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-bccffff7-e557-4f27-a5b7-6b43f5dfd767 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:56.537131 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bccffff7-e557-4f27-a5b7-6b43f5dfd767 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:56.537827 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bccffff7-e557-4f27-a5b7-6b43f5dfd767 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:56.538792 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bccffff7-e557-4f27-a5b7-6b43f5dfd767 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:56.539481 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bccffff7-e557-4f27-a5b7-6b43f5dfd767 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:56.731569 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-bccffff7-e557-4f27-a5b7-6b43f5dfd767 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:56.742950 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-bccffff7-e557-4f27-a5b7-6b43f5dfd767 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.217900 Jun 27 15:48:56.743842 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 67/134] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:56 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:57.427147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-563f7413-ecd1-4168-bdf0-b2eed25ebc58 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:57.428336 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-563f7413-ecd1-4168-bdf0-b2eed25ebc58 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:57.435846 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-563f7413-ecd1-4168-bdf0-b2eed25ebc58 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:57.436306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-563f7413-ecd1-4168-bdf0-b2eed25ebc58 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:57.437124 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-563f7413-ecd1-4168-bdf0-b2eed25ebc58 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:57.437568 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-563f7413-ecd1-4168-bdf0-b2eed25ebc58 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:57.581180 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-563f7413-ecd1-4168-bdf0-b2eed25ebc58 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:57.589292 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-563f7413-ecd1-4168-bdf0-b2eed25ebc58 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.165959 Jun 27 15:48:57.589888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 68/135] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:57 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:57.763047 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-0cfc078f-4406-491d-af4d-c5cad8c027f6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:57.772850 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-0cfc078f-4406-491d-af4d-c5cad8c027f6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:57.776327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=76 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:48:57.781191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0cfc078f-4406-491d-af4d-c5cad8c027f6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:57.781572 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0cfc078f-4406-491d-af4d-c5cad8c027f6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:57.782550 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0cfc078f-4406-491d-af4d-c5cad8c027f6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:57.782982 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0cfc078f-4406-491d-af4d-c5cad8c027f6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:57.963376 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0cfc078f-4406-491d-af4d-c5cad8c027f6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:57.971197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-0cfc078f-4406-491d-af4d-c5cad8c027f6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.212888 Jun 27 15:48:57.971773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 68/136] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:57 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:58.606857 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e4c99fac-2a9e-475a-8eda-381b3150865b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:58.607507 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e4c99fac-2a9e-475a-8eda-381b3150865b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:58.613855 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e4c99fac-2a9e-475a-8eda-381b3150865b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:58.614533 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e4c99fac-2a9e-475a-8eda-381b3150865b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:58.615318 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e4c99fac-2a9e-475a-8eda-381b3150865b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:58.615898 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e4c99fac-2a9e-475a-8eda-381b3150865b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:58.787737 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e4c99fac-2a9e-475a-8eda-381b3150865b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:58.796693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e4c99fac-2a9e-475a-8eda-381b3150865b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.193708 Jun 27 15:48:58.797736 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 69/137] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:58 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:58.991320 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-55a9b9af-bde3-45ba-b5e2-690f7ba9edf2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:58.992599 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-55a9b9af-bde3-45ba-b5e2-690f7ba9edf2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:58.999612 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-55a9b9af-bde3-45ba-b5e2-690f7ba9edf2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:59.000471 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-55a9b9af-bde3-45ba-b5e2-690f7ba9edf2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:59.001556 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-55a9b9af-bde3-45ba-b5e2-690f7ba9edf2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:59.002482 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-55a9b9af-bde3-45ba-b5e2-690f7ba9edf2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:59.172789 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-55a9b9af-bde3-45ba-b5e2-690f7ba9edf2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:48:59.183898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-55a9b9af-bde3-45ba-b5e2-690f7ba9edf2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.196224 Jun 27 15:48:59.184589 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 69/138] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:58 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:48:59.817915 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-5e9f2fcc-8f13-46db-ab18-da0531189940 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:48:59.818523 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-5e9f2fcc-8f13-46db-ab18-da0531189940 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:48:59.832305 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5e9f2fcc-8f13-46db-ab18-da0531189940 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:59.832766 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5e9f2fcc-8f13-46db-ab18-da0531189940 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:48:59.834079 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5e9f2fcc-8f13-46db-ab18-da0531189940 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:48:59.834504 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5e9f2fcc-8f13-46db-ab18-da0531189940 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:00.084979 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-5e9f2fcc-8f13-46db-ab18-da0531189940 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:00.093049 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-5e9f2fcc-8f13-46db-ab18-da0531189940 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.279742 Jun 27 15:49:00.103726 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 70/139] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:48:59 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:00.137038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8e099d0b-ff86-42d7-8c2b-df8add44828f tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78ad9301-e03f-4071-8a0f-2d6758ac41a4"}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:49:00.138218 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8e099d0b-ff86-42d7-8c2b-df8add44828f tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:00.145749 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8e099d0b-ff86-42d7-8c2b-df8add44828f tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:00.147207 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8e099d0b-ff86-42d7-8c2b-df8add44828f tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:00.148221 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8e099d0b-ff86-42d7-8c2b-df8add44828f tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:00.148862 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8e099d0b-ff86-42d7-8c2b-df8add44828f tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:00.205501 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-316e0eae-1ef3-45e8-b257-fe65f118cf3f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:00.206313 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-316e0eae-1ef3-45e8-b257-fe65f118cf3f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:00.217604 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-316e0eae-1ef3-45e8-b257-fe65f118cf3f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:00.220308 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-316e0eae-1ef3-45e8-b257-fe65f118cf3f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:00.221128 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-316e0eae-1ef3-45e8-b257-fe65f118cf3f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:00.221630 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-316e0eae-1ef3-45e8-b257-fe65f118cf3f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:00.443053 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-316e0eae-1ef3-45e8-b257-fe65f118cf3f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:00.451676 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-316e0eae-1ef3-45e8-b257-fe65f118cf3f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1322 microversion: 2.1 time: 0.251149 Jun 27 15:49:00.455938 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 71/140] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:00 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:00.951607 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-b12a7bf5-e29d-48f3-b465-a2c998927054 req-b658b197-6519-4f98-887e-7fdcf29faa2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1e27a3-c6e6-42ec-9a80-fa6806324aeb", "name": "network-vif-plugged", "status": "completed", "tag": "b6437b54-dcf4-4813-87ad-d62ddc232007"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:49:00.970011 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-b12a7bf5-e29d-48f3-b465-a2c998927054 req-b658b197-6519-4f98-887e-7fdcf29faa2f service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:00.971127 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-b12a7bf5-e29d-48f3-b465-a2c998927054 req-b658b197-6519-4f98-887e-7fdcf29faa2f service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:00.986770 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-b12a7bf5-e29d-48f3-b465-a2c998927054 req-b658b197-6519-4f98-887e-7fdcf29faa2f service nova] Creating event network-vif-plugged:b6437b54-dcf4-4813-87ad-d62ddc232007 for instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb on hv-cinder-84780 Jun 27 15:49:00.992906 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-b12a7bf5-e29d-48f3-b465-a2c998927054 req-b658b197-6519-4f98-887e-7fdcf29faa2f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045663 Jun 27 15:49:00.993534 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 72/141] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:49:01.118112 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-cdb3924f-b9c2-4a25-bece-961e03a0082b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:01.119925 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-cdb3924f-b9c2-4a25-bece-961e03a0082b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:01.133161 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cdb3924f-b9c2-4a25-bece-961e03a0082b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:01.133790 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cdb3924f-b9c2-4a25-bece-961e03a0082b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:01.134869 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cdb3924f-b9c2-4a25-bece-961e03a0082b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:01.135509 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cdb3924f-b9c2-4a25-bece-961e03a0082b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:01.354083 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-cdb3924f-b9c2-4a25-bece-961e03a0082b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:01.363154 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-cdb3924f-b9c2-4a25-bece-961e03a0082b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.253157 Jun 27 15:49:01.366018 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 73/142] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:01 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:01.476900 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-334eb1c4-d6f5-48d9-819e-ec4c28b6aae7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:01.477823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-334eb1c4-d6f5-48d9-819e-ec4c28b6aae7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:01.485797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-334eb1c4-d6f5-48d9-819e-ec4c28b6aae7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:01.486946 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-334eb1c4-d6f5-48d9-819e-ec4c28b6aae7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:01.488416 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-334eb1c4-d6f5-48d9-819e-ec4c28b6aae7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:01.489002 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-334eb1c4-d6f5-48d9-819e-ec4c28b6aae7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:01.653198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-334eb1c4-d6f5-48d9-819e-ec4c28b6aae7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:01.661578 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-334eb1c4-d6f5-48d9-819e-ec4c28b6aae7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1516 microversion: 2.1 time: 0.190453 Jun 27 15:49:01.662687 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 74/143] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:01 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:01.680966 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-38ad6761-003c-4ced-ab26-20c1ced94fb4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:49:01.682167 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-38ad6761-003c-4ced-ab26-20c1ced94fb4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:01.688512 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-38ad6761-003c-4ced-ab26-20c1ced94fb4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:01.688857 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-38ad6761-003c-4ced-ab26-20c1ced94fb4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:01.689907 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-38ad6761-003c-4ced-ab26-20c1ced94fb4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:01.690257 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-38ad6761-003c-4ced-ab26-20c1ced94fb4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:01.766462 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.objects.instance [None req-38ad6761-003c-4ced-ab26-20c1ced94fb4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lazy-loading 'flavor' on Instance uuid 470a42f9-27c4-4ae0-958d-f3de3d434563 {{(pid=129473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:49:01.860487 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:49:01.937994 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-38ad6761-003c-4ced-ab26-20c1ced94fb4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "POST /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563/action" status: 200 len: 32 microversion: 2.1 time: 0.261639 Jun 27 15:49:01.939768 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 75/144] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 27 15:49:01 2022] POST /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563/action => generated 32 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 15:49:01.955342 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b832ef50-c5ec-469c-9fb5-f9b884a60f5e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:01.957176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b832ef50-c5ec-469c-9fb5-f9b884a60f5e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:01.969608 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b832ef50-c5ec-469c-9fb5-f9b884a60f5e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:01.970077 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b832ef50-c5ec-469c-9fb5-f9b884a60f5e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:01.971681 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b832ef50-c5ec-469c-9fb5-f9b884a60f5e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:01.972225 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b832ef50-c5ec-469c-9fb5-f9b884a60f5e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:02.391838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b832ef50-c5ec-469c-9fb5-f9b884a60f5e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:02.403881 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b832ef50-c5ec-469c-9fb5-f9b884a60f5e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.455327 Jun 27 15:49:02.404376 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 76/145] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:01 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:02.420282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c8fe6a28-5963-4162-9d90-8f89f623785f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:02.423634 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c8fe6a28-5963-4162-9d90-8f89f623785f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:02.446944 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c8fe6a28-5963-4162-9d90-8f89f623785f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:02.449553 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c8fe6a28-5963-4162-9d90-8f89f623785f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:02.451696 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c8fe6a28-5963-4162-9d90-8f89f623785f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:02.452243 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c8fe6a28-5963-4162-9d90-8f89f623785f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:02.486792 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-8e099d0b-ff86-42d7-8c2b-df8add44828f tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "POST /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.352226 Jun 27 15:49:02.490778 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 70/146] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 27 15:49:00 2022] POST /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1/os-volume_attachments => generated 194 bytes in 2359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:49:02.942239 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-c8fe6a28-5963-4162-9d90-8f89f623785f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:02.960579 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c8fe6a28-5963-4162-9d90-8f89f623785f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.538960 Jun 27 15:49:02.973107 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 77/147] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:02 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:03.430579 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3f06c8b1-a89b-4a99-b737-38932173bd4e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:03.431519 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3f06c8b1-a89b-4a99-b737-38932173bd4e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:03.448005 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3f06c8b1-a89b-4a99-b737-38932173bd4e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:03.448553 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3f06c8b1-a89b-4a99-b737-38932173bd4e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:03.449376 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3f06c8b1-a89b-4a99-b737-38932173bd4e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:03.450424 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3f06c8b1-a89b-4a99-b737-38932173bd4e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:03.863765 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3f06c8b1-a89b-4a99-b737-38932173bd4e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:03.873489 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:49:03.893479 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3f06c8b1-a89b-4a99-b737-38932173bd4e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.474579 Jun 27 15:49:03.894548 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 71/148] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:03 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:03.981987 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-5bc87f1d-d82f-46d4-94a2-219f35e41adb tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:03.982752 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-5bc87f1d-d82f-46d4-94a2-219f35e41adb tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:03.997260 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5bc87f1d-d82f-46d4-94a2-219f35e41adb tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:03.997747 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5bc87f1d-d82f-46d4-94a2-219f35e41adb tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:03.998525 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5bc87f1d-d82f-46d4-94a2-219f35e41adb tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:03.998958 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5bc87f1d-d82f-46d4-94a2-219f35e41adb tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:04.170268 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-5bc87f1d-d82f-46d4-94a2-219f35e41adb tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:04.180108 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-5bc87f1d-d82f-46d4-94a2-219f35e41adb tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1363 microversion: 2.1 time: 0.202672 Jun 27 15:49:04.181027 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 78/149] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:03 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:04.922814 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-55b09f4a-9871-4535-b363-d2c8ef846eea tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:04.923433 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-55b09f4a-9871-4535-b363-d2c8ef846eea tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:04.939105 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-55b09f4a-9871-4535-b363-d2c8ef846eea tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:04.939555 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-55b09f4a-9871-4535-b363-d2c8ef846eea tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:04.940323 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-55b09f4a-9871-4535-b363-d2c8ef846eea tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:04.940770 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-55b09f4a-9871-4535-b363-d2c8ef846eea tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:05.200636 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-7109887f-0d10-44eb-a72b-1708f06bf3ef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:05.201308 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-7109887f-0d10-44eb-a72b-1708f06bf3ef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:05.204820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-55b09f4a-9871-4535-b363-d2c8ef846eea tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:05.207678 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7109887f-0d10-44eb-a72b-1708f06bf3ef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:05.208141 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7109887f-0d10-44eb-a72b-1708f06bf3ef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:05.210387 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7109887f-0d10-44eb-a72b-1708f06bf3ef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:05.211150 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7109887f-0d10-44eb-a72b-1708f06bf3ef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:05.215274 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-55b09f4a-9871-4535-b363-d2c8ef846eea tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.296478 Jun 27 15:49:05.217997 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 72/150] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:04 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:05.506545 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-7109887f-0d10-44eb-a72b-1708f06bf3ef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:05.518799 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-7109887f-0d10-44eb-a72b-1708f06bf3ef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1549 microversion: 2.1 time: 0.322415 Jun 27 15:49:05.519456 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 79/151] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:05 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1549 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:05.537001 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-362a2cbb-f9a7-4e3e-afcc-71f33c32c787 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:05.538109 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-362a2cbb-f9a7-4e3e-afcc-71f33c32c787 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:05.555123 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-362a2cbb-f9a7-4e3e-afcc-71f33c32c787 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:05.555888 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-362a2cbb-f9a7-4e3e-afcc-71f33c32c787 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:05.558759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-362a2cbb-f9a7-4e3e-afcc-71f33c32c787 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:05.559437 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-362a2cbb-f9a7-4e3e-afcc-71f33c32c787 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:05.709349 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-362a2cbb-f9a7-4e3e-afcc-71f33c32c787 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.176500 Jun 27 15:49:05.710365 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 73/152] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jun 27 15:49:05 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:49:06.234318 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-1510caa2-af84-4500-9e0f-58c46f88102e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:06.234958 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-1510caa2-af84-4500-9e0f-58c46f88102e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:06.262851 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1510caa2-af84-4500-9e0f-58c46f88102e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:06.263302 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1510caa2-af84-4500-9e0f-58c46f88102e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:06.269762 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1510caa2-af84-4500-9e0f-58c46f88102e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:06.270236 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1510caa2-af84-4500-9e0f-58c46f88102e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:06.904397 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-1510caa2-af84-4500-9e0f-58c46f88102e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:06.915373 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-1510caa2-af84-4500-9e0f-58c46f88102e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.683087 Jun 27 15:49:06.916450 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 80/153] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:06 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:07.126211 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-b302a176-9e71-49b4-90ce-8b34134bb041 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1107634896", "imageRef": "11f9be98-90d6-4c67-8d66-0b944f5a2a2b", "flavorRef": "452"}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:49:07.241086 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.network.neutron [None req-b302a176-9e71-49b4-90ce-8b34134bb041 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] validate_networks() for None {{(pid=129472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:49:07.934418 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-15404fe0-6b7a-4057-adaa-d25a53db1f62 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:07.935040 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-15404fe0-6b7a-4057-adaa-d25a53db1f62 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:07.945089 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-15404fe0-6b7a-4057-adaa-d25a53db1f62 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:07.945089 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-15404fe0-6b7a-4057-adaa-d25a53db1f62 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:07.945794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-15404fe0-6b7a-4057-adaa-d25a53db1f62 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:07.946236 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-15404fe0-6b7a-4057-adaa-d25a53db1f62 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:07.961919 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-b302a176-9e71-49b4-90ce-8b34134bb041 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Flavor limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:49:07.962335 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-b302a176-9e71-49b4-90ce-8b34134bb041 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Image limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:49:07.962801 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-b302a176-9e71-49b4-90ce-8b34134bb041 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Flavor pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:49:07.963202 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-b302a176-9e71-49b4-90ce-8b34134bb041 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Image pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:49:07.963602 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-b302a176-9e71-49b4-90ce-8b34134bb041 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:49:07.987442 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b302a176-9e71-49b4-90ce-8b34134bb041 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:07.987830 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b302a176-9e71-49b4-90ce-8b34134bb041 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:07.988623 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b302a176-9e71-49b4-90ce-8b34134bb041 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:07.989051 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b302a176-9e71-49b4-90ce-8b34134bb041 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:08.009320 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-b302a176-9e71-49b4-90ce-8b34134bb041 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Getting quotas for project 009dfcdbdd3840189d5222ff1606f4fa. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:49:08.014267 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-b302a176-9e71-49b4-90ce-8b34134bb041 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Getting quotas for user 364c6c6f607045d988dd55d8f467b027 and project 009dfcdbdd3840189d5222ff1606f4fa. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:49:08.029483 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-b302a176-9e71-49b4-90ce-8b34134bb041 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Going to run 1 instances... {{(pid=129472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:49:08.032148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-b302a176-9e71-49b4-90ce-8b34134bb041 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11f9be98-90d6-4c67-8d66-0b944f5a2a2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:49:08.116063 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-b302a176-9e71-49b4-90ce-8b34134bb041 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.994485 Jun 27 15:49:08.118736 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 74/154] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 15:49:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:49:08.129595 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8c3d034c-9a4d-43d3-b51e-f3a0816ab742 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:08.131040 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8c3d034c-9a4d-43d3-b51e-f3a0816ab742 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:08.433335 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8c3d034c-9a4d-43d3-b51e-f3a0816ab742 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364c6c6f607045d988dd55d8f467b027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009dfcdbdd3840189d5222ff1606f4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:08.468482 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-8c3d034c-9a4d-43d3-b51e-f3a0816ab742 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc" status: 200 len: 1215 microversion: 2.1 time: 0.342259 Jun 27 15:49:08.480105 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 75/155] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:08 2022] GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc => generated 1215 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:08.652043 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-15404fe0-6b7a-4057-adaa-d25a53db1f62 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:08.662984 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-15404fe0-6b7a-4057-adaa-d25a53db1f62 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.732608 Jun 27 15:49:08.666370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-530fdd98-6446-49dd-ac45-23010dfc504c req-441d5be1-d181-4cd2-bdbd-b382b945eb50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1e27a3-c6e6-42ec-9a80-fa6806324aeb", "tag": "b6437b54-dcf4-4813-87ad-d62ddc232007"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:49:08.666781 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 81/156] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:07 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:08.675250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-530fdd98-6446-49dd-ac45-23010dfc504c req-441d5be1-d181-4cd2-bdbd-b382b945eb50 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:08.675741 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-530fdd98-6446-49dd-ac45-23010dfc504c req-441d5be1-d181-4cd2-bdbd-b382b945eb50 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:08.690327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-530fdd98-6446-49dd-ac45-23010dfc504c req-441d5be1-d181-4cd2-bdbd-b382b945eb50 service nova] Creating event network-changed:b6437b54-dcf4-4813-87ad-d62ddc232007 for instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb on hv-cinder-84780 Jun 27 15:49:08.698331 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-530fdd98-6446-49dd-ac45-23010dfc504c req-441d5be1-d181-4cd2-bdbd-b382b945eb50 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035482 Jun 27 15:49:08.703269 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 76/157] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:49:09.487624 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-61bb2a54-ac66-44e9-9c21-dd8f28e5c0f6 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:09.488270 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-61bb2a54-ac66-44e9-9c21-dd8f28e5c0f6 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:09.503596 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-61bb2a54-ac66-44e9-9c21-dd8f28e5c0f6 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:09.504584 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-61bb2a54-ac66-44e9-9c21-dd8f28e5c0f6 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:09.507272 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-61bb2a54-ac66-44e9-9c21-dd8f28e5c0f6 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:09.507821 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-61bb2a54-ac66-44e9-9c21-dd8f28e5c0f6 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:09.623842 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-61bb2a54-ac66-44e9-9c21-dd8f28e5c0f6 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364c6c6f607045d988dd55d8f467b027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009dfcdbdd3840189d5222ff1606f4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:09.635238 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-61bb2a54-ac66-44e9-9c21-dd8f28e5c0f6 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc" status: 200 len: 1267 microversion: 2.1 time: 0.151841 Jun 27 15:49:09.637907 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 82/158] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:09 2022] GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:09.686474 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-6b138305-7716-4dcb-a536-9b32ecf27eb9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:09.688447 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-6b138305-7716-4dcb-a536-9b32ecf27eb9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:09.699774 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6b138305-7716-4dcb-a536-9b32ecf27eb9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:09.701157 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6b138305-7716-4dcb-a536-9b32ecf27eb9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:09.702662 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6b138305-7716-4dcb-a536-9b32ecf27eb9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:09.703398 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6b138305-7716-4dcb-a536-9b32ecf27eb9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:09.971318 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-6b138305-7716-4dcb-a536-9b32ecf27eb9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:09.980907 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-6b138305-7716-4dcb-a536-9b32ecf27eb9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.303932 Jun 27 15:49:09.981526 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 77/159] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:09 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:10.657989 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4843be7d-4a2e-4fcd-ad53-257e61a796ab tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:10.658632 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-4843be7d-4a2e-4fcd-ad53-257e61a796ab tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:10.667734 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4843be7d-4a2e-4fcd-ad53-257e61a796ab tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:10.668184 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4843be7d-4a2e-4fcd-ad53-257e61a796ab tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:10.669025 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4843be7d-4a2e-4fcd-ad53-257e61a796ab tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:10.669502 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4843be7d-4a2e-4fcd-ad53-257e61a796ab tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:10.788453 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4843be7d-4a2e-4fcd-ad53-257e61a796ab tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364c6c6f607045d988dd55d8f467b027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009dfcdbdd3840189d5222ff1606f4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:10.797515 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4843be7d-4a2e-4fcd-ad53-257e61a796ab tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc" status: 200 len: 1273 microversion: 2.1 time: 0.145333 Jun 27 15:49:10.808213 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 83/160] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:10 2022] GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:10.998650 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ee916338-1961-47a6-89d3-369dda362a9e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:11.000201 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-ee916338-1961-47a6-89d3-369dda362a9e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:11.008996 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ee916338-1961-47a6-89d3-369dda362a9e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:11.009812 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ee916338-1961-47a6-89d3-369dda362a9e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:11.010753 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ee916338-1961-47a6-89d3-369dda362a9e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:11.011348 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ee916338-1961-47a6-89d3-369dda362a9e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:11.193953 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ee916338-1961-47a6-89d3-369dda362a9e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:11.206204 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ee916338-1961-47a6-89d3-369dda362a9e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.211669 Jun 27 15:49:11.206888 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 78/161] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:10 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:11.815862 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-142a969f-a4ea-48d8-ae9b-7a580b1387a9 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:11.816773 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-142a969f-a4ea-48d8-ae9b-7a580b1387a9 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:11.825291 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-142a969f-a4ea-48d8-ae9b-7a580b1387a9 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:11.826095 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-142a969f-a4ea-48d8-ae9b-7a580b1387a9 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:11.827106 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-142a969f-a4ea-48d8-ae9b-7a580b1387a9 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:11.828056 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-142a969f-a4ea-48d8-ae9b-7a580b1387a9 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:11.944738 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-142a969f-a4ea-48d8-ae9b-7a580b1387a9 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364c6c6f607045d988dd55d8f467b027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009dfcdbdd3840189d5222ff1606f4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:11.959621 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-142a969f-a4ea-48d8-ae9b-7a580b1387a9 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc" status: 200 len: 1273 microversion: 2.1 time: 0.147912 Jun 27 15:49:11.972562 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 84/162] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:11 2022] GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:12.224575 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-e7d9d93c-e1a7-4068-87cd-ea1fcb99a58b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:12.226009 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-e7d9d93c-e1a7-4068-87cd-ea1fcb99a58b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:12.244900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e7d9d93c-e1a7-4068-87cd-ea1fcb99a58b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:12.245343 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e7d9d93c-e1a7-4068-87cd-ea1fcb99a58b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:12.246147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e7d9d93c-e1a7-4068-87cd-ea1fcb99a58b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:12.246556 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e7d9d93c-e1a7-4068-87cd-ea1fcb99a58b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:12.618548 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-e7d9d93c-e1a7-4068-87cd-ea1fcb99a58b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:12.629617 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-e7d9d93c-e1a7-4068-87cd-ea1fcb99a58b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.408970 Jun 27 15:49:12.636805 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 79/163] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:12 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:12.977870 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-7f646898-0842-49ff-a42e-9d2cde4baf50 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:12.978632 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-7f646898-0842-49ff-a42e-9d2cde4baf50 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:12.985036 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7f646898-0842-49ff-a42e-9d2cde4baf50 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:12.985483 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7f646898-0842-49ff-a42e-9d2cde4baf50 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:12.986273 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7f646898-0842-49ff-a42e-9d2cde4baf50 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:12.986701 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7f646898-0842-49ff-a42e-9d2cde4baf50 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:13.402711 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-7f646898-0842-49ff-a42e-9d2cde4baf50 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364c6c6f607045d988dd55d8f467b027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009dfcdbdd3840189d5222ff1606f4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:13.414178 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-7f646898-0842-49ff-a42e-9d2cde4baf50 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc" status: 200 len: 1315 microversion: 2.1 time: 0.441063 Jun 27 15:49:13.428583 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 85/164] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:12 2022] GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:13.465037 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a2efada1-fd63-41fd-b78e-198d16198a4b tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:13.467392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a2efada1-fd63-41fd-b78e-198d16198a4b tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:13.483319 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a2efada1-fd63-41fd-b78e-198d16198a4b tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:13.486696 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a2efada1-fd63-41fd-b78e-198d16198a4b tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:13.488160 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a2efada1-fd63-41fd-b78e-198d16198a4b tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:13.488618 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a2efada1-fd63-41fd-b78e-198d16198a4b tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:13.569365 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a2efada1-fd63-41fd-b78e-198d16198a4b tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Going to try to terminate instance {{(pid=129472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:49:13.586564 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-67506bef-5410-45df-bfbd-f96291318639 req-1b94cfe3-9e2d-4845-83e0-88aaecbc18e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc", "tag": "18582df6-8cc0-42c2-ad82-f13300fb3449"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:49:13.613792 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-67506bef-5410-45df-bfbd-f96291318639 req-1b94cfe3-9e2d-4845-83e0-88aaecbc18e3 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:13.615056 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-67506bef-5410-45df-bfbd-f96291318639 req-1b94cfe3-9e2d-4845-83e0-88aaecbc18e3 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:13.636977 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-67506bef-5410-45df-bfbd-f96291318639 req-1b94cfe3-9e2d-4845-83e0-88aaecbc18e3 service nova] Creating event network-changed:18582df6-8cc0-42c2-ad82-f13300fb3449 for instance ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc on hv-cinder-84780 Jun 27 15:49:13.649646 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-67506bef-5410-45df-bfbd-f96291318639 req-1b94cfe3-9e2d-4845-83e0-88aaecbc18e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084434 Jun 27 15:49:13.652091 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 86/165] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:49:13.665143 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-597e0843-7fb4-473a-b7ae-978780611d4d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:13.667311 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-597e0843-7fb4-473a-b7ae-978780611d4d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:13.680549 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-597e0843-7fb4-473a-b7ae-978780611d4d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:13.681427 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-597e0843-7fb4-473a-b7ae-978780611d4d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:13.682634 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-597e0843-7fb4-473a-b7ae-978780611d4d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:13.683764 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-597e0843-7fb4-473a-b7ae-978780611d4d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:13.750443 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-a2efada1-fd63-41fd-b78e-198d16198a4b tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 204 len: 0 microversion: 2.1 time: 0.296986 Jun 27 15:49:13.751798 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 80/166] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:49:13 2022] DELETE /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:49:13.766161 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-907d9f03-251d-40d7-af55-0c6aabe3bbf3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:13.767431 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-907d9f03-251d-40d7-af55-0c6aabe3bbf3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:13.775753 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-907d9f03-251d-40d7-af55-0c6aabe3bbf3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:13.776524 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-907d9f03-251d-40d7-af55-0c6aabe3bbf3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:13.777446 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-907d9f03-251d-40d7-af55-0c6aabe3bbf3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:13.778190 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-907d9f03-251d-40d7-af55-0c6aabe3bbf3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:14.024506 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-907d9f03-251d-40d7-af55-0c6aabe3bbf3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:14.032646 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-597e0843-7fb4-473a-b7ae-978780611d4d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:14.033558 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-907d9f03-251d-40d7-af55-0c6aabe3bbf3 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1553 microversion: 2.1 time: 0.274491 Jun 27 15:49:14.034669 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 81/167] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:13 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1553 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:14.041209 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-597e0843-7fb4-473a-b7ae-978780611d4d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.387569 Jun 27 15:49:14.047141 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 87/168] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:13 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:14.432945 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-cc66ff08-9996-431d-9c76-0ddf8af83df3 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:14.433587 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-cc66ff08-9996-431d-9c76-0ddf8af83df3 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:14.440834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cc66ff08-9996-431d-9c76-0ddf8af83df3 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:14.441496 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cc66ff08-9996-431d-9c76-0ddf8af83df3 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:14.443083 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cc66ff08-9996-431d-9c76-0ddf8af83df3 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:14.443884 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cc66ff08-9996-431d-9c76-0ddf8af83df3 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:14.641651 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-cc66ff08-9996-431d-9c76-0ddf8af83df3 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364c6c6f607045d988dd55d8f467b027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009dfcdbdd3840189d5222ff1606f4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:14.652393 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-cc66ff08-9996-431d-9c76-0ddf8af83df3 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc" status: 200 len: 1315 microversion: 2.1 time: 0.223456 Jun 27 15:49:14.656140 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 82/169] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:14 2022] GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:15.055633 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-959dd484-9449-4c60-a20e-0f1a9a3beb61 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:15.056268 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-959dd484-9449-4c60-a20e-0f1a9a3beb61 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:15.063103 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-959dd484-9449-4c60-a20e-0f1a9a3beb61 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:15.063989 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-dc160742-fada-4864-984b-f64bfc4c4daf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:15.064457 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-959dd484-9449-4c60-a20e-0f1a9a3beb61 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:15.065187 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-dc160742-fada-4864-984b-f64bfc4c4daf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:15.065924 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-959dd484-9449-4c60-a20e-0f1a9a3beb61 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:15.066551 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-959dd484-9449-4c60-a20e-0f1a9a3beb61 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:15.076376 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dc160742-fada-4864-984b-f64bfc4c4daf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:15.076851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dc160742-fada-4864-984b-f64bfc4c4daf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:15.078390 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dc160742-fada-4864-984b-f64bfc4c4daf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:15.078958 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dc160742-fada-4864-984b-f64bfc4c4daf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:15.286514 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-959dd484-9449-4c60-a20e-0f1a9a3beb61 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:15.295101 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-959dd484-9449-4c60-a20e-0f1a9a3beb61 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1553 microversion: 2.1 time: 0.244748 Jun 27 15:49:15.295687 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 88/170] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:15 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1553 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:15.299297 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-dc160742-fada-4864-984b-f64bfc4c4daf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:15.308373 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-dc160742-fada-4864-984b-f64bfc4c4daf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.249303 Jun 27 15:49:15.309150 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 83/171] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:15 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:15.673546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-cf65e9e4-22a7-48fc-8e2e-94dc291514d7 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:15.676962 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-cf65e9e4-22a7-48fc-8e2e-94dc291514d7 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:15.681585 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cf65e9e4-22a7-48fc-8e2e-94dc291514d7 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:15.682351 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cf65e9e4-22a7-48fc-8e2e-94dc291514d7 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:15.683343 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cf65e9e4-22a7-48fc-8e2e-94dc291514d7 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:15.683843 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cf65e9e4-22a7-48fc-8e2e-94dc291514d7 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:15.865050 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-cf65e9e4-22a7-48fc-8e2e-94dc291514d7 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364c6c6f607045d988dd55d8f467b027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009dfcdbdd3840189d5222ff1606f4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:15.873163 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-cf65e9e4-22a7-48fc-8e2e-94dc291514d7 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc" status: 200 len: 1315 microversion: 2.1 time: 0.203808 Jun 27 15:49:15.873931 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 89/172] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:15 2022] GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:16.312255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-036deb38-7c5d-4b17-a070-316afca0e1cf tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:16.312866 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-036deb38-7c5d-4b17-a070-316afca0e1cf tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:16.325948 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d2c3d6a3-0ffe-4ed5-a82e-08b120cf3937 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:16.326660 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d2c3d6a3-0ffe-4ed5-a82e-08b120cf3937 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:16.332852 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d2c3d6a3-0ffe-4ed5-a82e-08b120cf3937 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:16.335380 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-036deb38-7c5d-4b17-a070-316afca0e1cf tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:16.336892 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d2c3d6a3-0ffe-4ed5-a82e-08b120cf3937 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:16.338496 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d2c3d6a3-0ffe-4ed5-a82e-08b120cf3937 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:16.339218 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d2c3d6a3-0ffe-4ed5-a82e-08b120cf3937 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:16.341682 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-036deb38-7c5d-4b17-a070-316afca0e1cf tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:16.343150 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-036deb38-7c5d-4b17-a070-316afca0e1cf tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:16.343873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-036deb38-7c5d-4b17-a070-316afca0e1cf tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:16.675555 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-036deb38-7c5d-4b17-a070-316afca0e1cf tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:16.694210 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d2c3d6a3-0ffe-4ed5-a82e-08b120cf3937 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:16.702927 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-036deb38-7c5d-4b17-a070-316afca0e1cf tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1553 microversion: 2.1 time: 0.394202 Jun 27 15:49:16.704220 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 84/173] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:16 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1553 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:16.708860 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d2c3d6a3-0ffe-4ed5-a82e-08b120cf3937 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.385591 Jun 27 15:49:16.710021 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 90/174] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:16 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:49:16.891292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-34bfbea0-3a4a-49e3-b7db-e087b7bcce5e tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:16.892512 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-34bfbea0-3a4a-49e3-b7db-e087b7bcce5e tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:16.901311 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-34bfbea0-3a4a-49e3-b7db-e087b7bcce5e tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:16.901966 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-34bfbea0-3a4a-49e3-b7db-e087b7bcce5e tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:16.902912 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-34bfbea0-3a4a-49e3-b7db-e087b7bcce5e tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:16.903354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-34bfbea0-3a4a-49e3-b7db-e087b7bcce5e tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:17.081914 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-34bfbea0-3a4a-49e3-b7db-e087b7bcce5e tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364c6c6f607045d988dd55d8f467b027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009dfcdbdd3840189d5222ff1606f4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:17.092401 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-34bfbea0-3a4a-49e3-b7db-e087b7bcce5e tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc" status: 200 len: 1315 microversion: 2.1 time: 0.205196 Jun 27 15:49:17.093360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 85/175] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:16 2022] GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:17.734213 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f3010de4-8b29-4e0d-8882-2ee5dc959670 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:17.734926 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-905e0ce1-43c8-4c99-9c3a-3932b9c34f94 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:17.735323 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f3010de4-8b29-4e0d-8882-2ee5dc959670 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:17.735400 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-905e0ce1-43c8-4c99-9c3a-3932b9c34f94 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:17.741618 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-905e0ce1-43c8-4c99-9c3a-3932b9c34f94 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:17.741812 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f3010de4-8b29-4e0d-8882-2ee5dc959670 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:17.742101 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-905e0ce1-43c8-4c99-9c3a-3932b9c34f94 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:17.742245 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f3010de4-8b29-4e0d-8882-2ee5dc959670 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:17.742960 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f3010de4-8b29-4e0d-8882-2ee5dc959670 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:17.743348 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-905e0ce1-43c8-4c99-9c3a-3932b9c34f94 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:17.743469 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f3010de4-8b29-4e0d-8882-2ee5dc959670 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:17.744108 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-905e0ce1-43c8-4c99-9c3a-3932b9c34f94 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:17.979796 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f3010de4-8b29-4e0d-8882-2ee5dc959670 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:17.983040 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-905e0ce1-43c8-4c99-9c3a-3932b9c34f94 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:17.991981 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f3010de4-8b29-4e0d-8882-2ee5dc959670 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.261911 Jun 27 15:49:17.992140 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-905e0ce1-43c8-4c99-9c3a-3932b9c34f94 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1553 microversion: 2.1 time: 0.261993 Jun 27 15:49:17.992632 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 91/176] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:17 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:17.995724 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 86/177] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:17 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:18.111293 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-419f6123-d64c-4f98-b4ec-cc94e8e2e9b1 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:18.111948 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-419f6123-d64c-4f98-b4ec-cc94e8e2e9b1 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:18.118973 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-419f6123-d64c-4f98-b4ec-cc94e8e2e9b1 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:18.119443 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-419f6123-d64c-4f98-b4ec-cc94e8e2e9b1 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:18.120227 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-419f6123-d64c-4f98-b4ec-cc94e8e2e9b1 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:18.120923 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-419f6123-d64c-4f98-b4ec-cc94e8e2e9b1 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:18.125354 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:49:18.276266 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-419f6123-d64c-4f98-b4ec-cc94e8e2e9b1 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364c6c6f607045d988dd55d8f467b027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009dfcdbdd3840189d5222ff1606f4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:18.283987 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-419f6123-d64c-4f98-b4ec-cc94e8e2e9b1 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc" status: 200 len: 1315 microversion: 2.1 time: 0.177639 Jun 27 15:49:18.284795 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 92/178] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:18 2022] GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:19.013237 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-1bcce737-a681-4f0c-94a5-63945aed0622 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:19.013876 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b5b91128-be6d-42a8-bf79-e9946d199724 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:19.014579 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b5b91128-be6d-42a8-bf79-e9946d199724 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:19.015671 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-1bcce737-a681-4f0c-94a5-63945aed0622 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:19.023840 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=2 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:49:19.024902 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=8 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:49:19.028485 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1bcce737-a681-4f0c-94a5-63945aed0622 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:19.028943 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b5b91128-be6d-42a8-bf79-e9946d199724 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:19.030193 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1bcce737-a681-4f0c-94a5-63945aed0622 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:19.030669 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b5b91128-be6d-42a8-bf79-e9946d199724 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:19.031787 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1bcce737-a681-4f0c-94a5-63945aed0622 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:19.032368 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1bcce737-a681-4f0c-94a5-63945aed0622 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:19.035019 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b5b91128-be6d-42a8-bf79-e9946d199724 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:19.037724 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b5b91128-be6d-42a8-bf79-e9946d199724 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:19.403443 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b5b91128-be6d-42a8-bf79-e9946d199724 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:19.424815 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b5b91128-be6d-42a8-bf79-e9946d199724 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.417119 Jun 27 15:49:19.437363 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 93/179] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:19 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:49:19.437363 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4e216826-ed37-43a6-aec8-ddaace421b41 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:19.437363 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-4e216826-ed37-43a6-aec8-ddaace421b41 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:19.443183 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4e216826-ed37-43a6-aec8-ddaace421b41 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:19.443851 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4e216826-ed37-43a6-aec8-ddaace421b41 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:19.444622 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4e216826-ed37-43a6-aec8-ddaace421b41 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:19.445053 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4e216826-ed37-43a6-aec8-ddaace421b41 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:19.470670 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-1bcce737-a681-4f0c-94a5-63945aed0622 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:19.487996 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-1bcce737-a681-4f0c-94a5-63945aed0622 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1553 microversion: 2.1 time: 0.480734 Jun 27 15:49:19.488590 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 87/180] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:19 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1553 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:19.529302 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-7fe4416a-9b63-46a9-9a5c-fa6604dd19d8 req-8446476f-b1d9-49b9-a7a9-c78c0b092c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4fbc86-ac2c-4bda-b073-02c52f0559f1", "name": "network-vif-deleted", "tag": "8c661832-e9de-45b0-be49-833df2b9cc70"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:49:19.545073 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-7fe4416a-9b63-46a9-9a5c-fa6604dd19d8 req-8446476f-b1d9-49b9-a7a9-c78c0b092c68 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:19.545829 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-7fe4416a-9b63-46a9-9a5c-fa6604dd19d8 req-8446476f-b1d9-49b9-a7a9-c78c0b092c68 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:19.570313 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-7fe4416a-9b63-46a9-9a5c-fa6604dd19d8 req-8446476f-b1d9-49b9-a7a9-c78c0b092c68 service nova] Creating event network-vif-deleted:8c661832-e9de-45b0-be49-833df2b9cc70 for instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 on hv-cinder-84780 Jun 27 15:49:19.577175 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-7fe4416a-9b63-46a9-9a5c-fa6604dd19d8 req-8446476f-b1d9-49b9-a7a9-c78c0b092c68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051368 Jun 27 15:49:19.581568 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 88/181] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:49:19.646403 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4e216826-ed37-43a6-aec8-ddaace421b41 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364c6c6f607045d988dd55d8f467b027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009dfcdbdd3840189d5222ff1606f4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:19.658815 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4e216826-ed37-43a6-aec8-ddaace421b41 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc" status: 200 len: 1315 microversion: 2.1 time: 0.232302 Jun 27 15:49:19.659411 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 94/182] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:19 2022] GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:20.459837 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-19ae7a2e-8cbc-4566-84be-897cf14abb80 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:20.461408 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-19ae7a2e-8cbc-4566-84be-897cf14abb80 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:20.470379 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-19ae7a2e-8cbc-4566-84be-897cf14abb80 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:20.471267 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-19ae7a2e-8cbc-4566-84be-897cf14abb80 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:20.472299 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-19ae7a2e-8cbc-4566-84be-897cf14abb80 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:20.473120 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-19ae7a2e-8cbc-4566-84be-897cf14abb80 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:20.507255 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-2648491f-566c-4a36-a855-b34535678944 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:20.508546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-2648491f-566c-4a36-a855-b34535678944 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:20.518069 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2648491f-566c-4a36-a855-b34535678944 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:20.518834 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2648491f-566c-4a36-a855-b34535678944 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:20.520147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2648491f-566c-4a36-a855-b34535678944 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:20.524319 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2648491f-566c-4a36-a855-b34535678944 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:20.628237 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2648491f-566c-4a36-a855-b34535678944 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3520bd4387a140f88558d5f6fe55986e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a805612e76c4f5e9052aa4a8ead24f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:20.639683 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-2648491f-566c-4a36-a855-b34535678944 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 200 len: 1345 microversion: 2.1 time: 0.137415 Jun 27 15:49:20.640410 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 95/183] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:20 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 1345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:20.687779 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0124c310-9c71-48c6-b649-31d25a7e789b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:20.688664 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-0124c310-9c71-48c6-b649-31d25a7e789b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:20.698041 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0124c310-9c71-48c6-b649-31d25a7e789b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:20.698683 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0124c310-9c71-48c6-b649-31d25a7e789b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:20.700204 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0124c310-9c71-48c6-b649-31d25a7e789b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:20.700799 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0124c310-9c71-48c6-b649-31d25a7e789b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:20.724685 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-19ae7a2e-8cbc-4566-84be-897cf14abb80 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:20.737926 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-19ae7a2e-8cbc-4566-84be-897cf14abb80 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.297122 Jun 27 15:49:20.742844 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 89/184] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:20 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:20.888150 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-0124c310-9c71-48c6-b649-31d25a7e789b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364c6c6f607045d988dd55d8f467b027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009dfcdbdd3840189d5222ff1606f4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:20.896338 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-0124c310-9c71-48c6-b649-31d25a7e789b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc" status: 200 len: 1315 microversion: 2.1 time: 0.212608 Jun 27 15:49:20.897737 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 96/185] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:20 2022] GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:21.501709 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-2e01407b-4df4-4f23-9a73-46fb59d98886 req-51f72c3f-a0f8-4344-a4a8-f281f4e27926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc", "name": "network-vif-plugged", "status": "completed", "tag": "18582df6-8cc0-42c2-ad82-f13300fb3449"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:49:21.515766 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-2e01407b-4df4-4f23-9a73-46fb59d98886 req-51f72c3f-a0f8-4344-a4a8-f281f4e27926 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:21.516158 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-2e01407b-4df4-4f23-9a73-46fb59d98886 req-51f72c3f-a0f8-4344-a4a8-f281f4e27926 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:21.521280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:49:21.536708 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-2e01407b-4df4-4f23-9a73-46fb59d98886 req-51f72c3f-a0f8-4344-a4a8-f281f4e27926 service nova] Creating event network-vif-plugged:18582df6-8cc0-42c2-ad82-f13300fb3449 for instance ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc on hv-cinder-84780 Jun 27 15:49:21.545055 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-2e01407b-4df4-4f23-9a73-46fb59d98886 req-51f72c3f-a0f8-4344-a4a8-f281f4e27926 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048651 Jun 27 15:49:21.546170 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 90/186] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:49:21.656284 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-bc70b4b8-5af5-4d2c-a282-c76b24992862 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:21.656954 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-bc70b4b8-5af5-4d2c-a282-c76b24992862 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:21.665701 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bc70b4b8-5af5-4d2c-a282-c76b24992862 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:21.666643 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bc70b4b8-5af5-4d2c-a282-c76b24992862 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:21.667808 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bc70b4b8-5af5-4d2c-a282-c76b24992862 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:21.668460 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bc70b4b8-5af5-4d2c-a282-c76b24992862 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:21.685183 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-bc70b4b8-5af5-4d2c-a282-c76b24992862 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] HTTP exception thrown: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-bc70b4b8-5af5-4d2c-a282-c76b24992862 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Request method failure captured: Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 HTTP/1.1 Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudEuMFdTg4SwtnadhVoN894S0abD3Eo3QphkC9OCoc0jK6ao3L8vwWdj8vwMtu1px7kuU_YvoMDXkN8Q4EFfXswStjoaJ7k7RxbEmrZPw5Fzz0hdTSBkTup6v5f3shxY2YoyB7ciS8u5dy73rlZQt_yW5nClxQviB7S3__3g1QEJ1KA Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 2a805612e76c4f5e9052aa4a8ead24f1 Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-DeleteServersTestJSON-135659793 Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:49:21.689916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:49:21.691143 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a805612e76c4f5e9052aa4a8ead24f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2a805612e76c4f5e9052aa4a8ead24f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a805612e76c4f5e9052aa4a8ead24f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2a805612e76c4f5e9052aa4a8ead24f1", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:49:21.691143 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-DeleteServersTestJSON-135659793 Jun 27 15:49:21.691143 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 2a805612e76c4f5e9052aa4a8ead24f1 Jun 27 15:49:21.691143 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-DeleteServersTestJSON-135659793 Jun 27 15:49:21.691143 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-DeleteServersTestJSON-135659793-project Jun 27 15:49:21.691143 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:49:21.691143 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:49:21.691143 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 3520bd4387a140f88558d5f6fe55986e Jun 27 15:49:21.691143 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-DeleteServersTestJSON-135659793-project Jun 27 15:49:21.691143 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:49:21.691143 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:21.691143 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': '9b4fbc86-ac2c-4bda-b073-02c52f0559f1'} Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:49:21.691823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:49:21.693280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:49:21.693280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:49:21.693280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:49:21.693280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:49:21.693280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:49:21.693280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:49:21.693280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:49:21.693280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:21.693280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:21.693280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:49:21.693280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:21.693280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:49:21.693280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:49:21.693280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:49:21.693280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:49:21.693280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:49:21.693280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:21.693280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:21.698936 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-bc70b4b8-5af5-4d2c-a282-c76b24992862 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Returning 404 to user: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:49:21.698936 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-bc70b4b8-5af5-4d2c-a282-c76b24992862 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 404 len: 111 microversion: 2.1 time: 0.039007 Jun 27 15:49:21.698936 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 97/187] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:21 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:49:21.765535 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-1940b61f-3da6-43a5-b57c-32f5d11ed90e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:21.766427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-1940b61f-3da6-43a5-b57c-32f5d11ed90e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:21.778242 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1940b61f-3da6-43a5-b57c-32f5d11ed90e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:21.778866 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1940b61f-3da6-43a5-b57c-32f5d11ed90e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:21.780365 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1940b61f-3da6-43a5-b57c-32f5d11ed90e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:21.781085 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1940b61f-3da6-43a5-b57c-32f5d11ed90e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:21.868239 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c7ccb778-2ab1-487e-9762-fe5f388ca44c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:21.869502 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c7ccb778-2ab1-487e-9762-fe5f388ca44c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:21.876792 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c7ccb778-2ab1-487e-9762-fe5f388ca44c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:21.877478 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c7ccb778-2ab1-487e-9762-fe5f388ca44c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:21.878441 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c7ccb778-2ab1-487e-9762-fe5f388ca44c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:21.879075 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c7ccb778-2ab1-487e-9762-fe5f388ca44c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:21.899177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-c7ccb778-2ab1-487e-9762-fe5f388ca44c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] HTTP exception thrown: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c7ccb778-2ab1-487e-9762-fe5f388ca44c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Request method failure captured: Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1/os-volume_attachments HTTP/1.1 Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudEuMFdTg4SwtnadhVoN894S0abD3Eo3QphkC9OCoc0jK6ao3L8vwWdj8vwMtu1px7kuU_YvoMDXkN8Q4EFfXswStjoaJ7k7RxbEmrZPw5Fzz0hdTSBkTup6v5f3shxY2YoyB7ciS8u5dy73rlZQt_yW5nClxQviB7S3__3g1QEJ1KA Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 2a805612e76c4f5e9052aa4a8ead24f1 Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-DeleteServersTestJSON-135659793 Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:49:21.901832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:49:21.903182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a805612e76c4f5e9052aa4a8ead24f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2a805612e76c4f5e9052aa4a8ead24f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a805612e76c4f5e9052aa4a8ead24f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2a805612e76c4f5e9052aa4a8ead24f1", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:49:21.903182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-DeleteServersTestJSON-135659793 Jun 27 15:49:21.903182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 2a805612e76c4f5e9052aa4a8ead24f1 Jun 27 15:49:21.903182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-DeleteServersTestJSON-135659793 Jun 27 15:49:21.903182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-DeleteServersTestJSON-135659793-project Jun 27 15:49:21.903182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:49:21.903182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:49:21.903182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 3520bd4387a140f88558d5f6fe55986e Jun 27 15:49:21.903182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-DeleteServersTestJSON-135659793-project Jun 27 15:49:21.903182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:49:21.903182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:21.903182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'server_id': '9b4fbc86-ac2c-4bda-b073-02c52f0559f1'} Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:49:21.903826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:21.904922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:21.908037 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c7ccb778-2ab1-487e-9762-fe5f388ca44c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Returning 404 to user: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:49:21.908037 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c7ccb778-2ab1-487e-9762-fe5f388ca44c tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039039 Jun 27 15:49:21.908037 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 98/188] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 27 15:49:21 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:49:21.917804 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-98f4c081-4f53-4e9b-8201-22d23a883fde tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:21.918547 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-98f4c081-4f53-4e9b-8201-22d23a883fde tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:21.926316 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-98f4c081-4f53-4e9b-8201-22d23a883fde tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:21.927315 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-98f4c081-4f53-4e9b-8201-22d23a883fde tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:21.928237 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-98f4c081-4f53-4e9b-8201-22d23a883fde tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:21.928822 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-98f4c081-4f53-4e9b-8201-22d23a883fde tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:21.987383 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-1940b61f-3da6-43a5-b57c-32f5d11ed90e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:21.999399 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-1940b61f-3da6-43a5-b57c-32f5d11ed90e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.238237 Jun 27 15:49:21.999983 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 91/189] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:21 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:22.105163 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-98f4c081-4f53-4e9b-8201-22d23a883fde tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364c6c6f607045d988dd55d8f467b027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009dfcdbdd3840189d5222ff1606f4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:22.115436 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-98f4c081-4f53-4e9b-8201-22d23a883fde tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc" status: 200 len: 1315 microversion: 2.1 time: 0.205588 Jun 27 15:49:22.116254 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 99/190] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:21 2022] GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:23.018239 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-5bb24485-09a4-4f0b-b61d-e4dd1d30a40b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:23.018850 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-5bb24485-09a4-4f0b-b61d-e4dd1d30a40b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:23.026792 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5bb24485-09a4-4f0b-b61d-e4dd1d30a40b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:23.027239 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5bb24485-09a4-4f0b-b61d-e4dd1d30a40b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:23.028020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5bb24485-09a4-4f0b-b61d-e4dd1d30a40b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:23.028456 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5bb24485-09a4-4f0b-b61d-e4dd1d30a40b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:23.134235 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f9f5fb66-3af1-4384-8935-db353edd653c tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:23.135556 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f9f5fb66-3af1-4384-8935-db353edd653c tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:23.137921 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=74 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:49:23.143092 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f9f5fb66-3af1-4384-8935-db353edd653c tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:23.143915 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f9f5fb66-3af1-4384-8935-db353edd653c tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:23.145112 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f9f5fb66-3af1-4384-8935-db353edd653c tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:23.146230 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f9f5fb66-3af1-4384-8935-db353edd653c tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:23.407927 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f9f5fb66-3af1-4384-8935-db353edd653c tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364c6c6f607045d988dd55d8f467b027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009dfcdbdd3840189d5222ff1606f4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:23.414408 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-5bb24485-09a4-4f0b-b61d-e4dd1d30a40b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:23.423729 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-5bb24485-09a4-4f0b-b61d-e4dd1d30a40b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.409243 Jun 27 15:49:23.424625 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 92/191] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:23 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:49:23.427294 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f9f5fb66-3af1-4384-8935-db353edd653c tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc" status: 200 len: 1315 microversion: 2.1 time: 0.297187 Jun 27 15:49:23.428455 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 100/192] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:23 2022] GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:49:23.438469 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3695a61e-d425-4001-b636-41c4259949ac tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:23.439033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3695a61e-d425-4001-b636-41c4259949ac tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:23.447582 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3695a61e-d425-4001-b636-41c4259949ac tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:23.448229 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3695a61e-d425-4001-b636-41c4259949ac tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:23.449130 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3695a61e-d425-4001-b636-41c4259949ac tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:23.449845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3695a61e-d425-4001-b636-41c4259949ac tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:23.466450 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-3695a61e-d425-4001-b636-41c4259949ac tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] HTTP exception thrown: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3695a61e-d425-4001-b636-41c4259949ac tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Request method failure captured: Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: DELETE /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 HTTP/1.1 Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudEuMFdTg4SwtnadhVoN894S0abD3Eo3QphkC9OCoc0jK6ao3L8vwWdj8vwMtu1px7kuU_YvoMDXkN8Q4EFfXswStjoaJ7k7RxbEmrZPw5Fzz0hdTSBkTup6v5f3shxY2YoyB7ciS8u5dy73rlZQt_yW5nClxQviB7S3__3g1QEJ1KA Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 2a805612e76c4f5e9052aa4a8ead24f1 Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-DeleteServersTestJSON-135659793 Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:49:23.472347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:49:23.474544 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a805612e76c4f5e9052aa4a8ead24f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2a805612e76c4f5e9052aa4a8ead24f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a805612e76c4f5e9052aa4a8ead24f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2a805612e76c4f5e9052aa4a8ead24f1", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:49:23.474544 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-DeleteServersTestJSON-135659793 Jun 27 15:49:23.474544 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 2a805612e76c4f5e9052aa4a8ead24f1 Jun 27 15:49:23.474544 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-DeleteServersTestJSON-135659793 Jun 27 15:49:23.474544 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-DeleteServersTestJSON-135659793-project Jun 27 15:49:23.474544 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:49:23.474544 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:49:23.474544 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: 3520bd4387a140f88558d5f6fe55986e Jun 27 15:49:23.474544 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-DeleteServersTestJSON-135659793-project Jun 27 15:49:23.474544 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:49:23.474544 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:23.474544 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': '9b4fbc86-ac2c-4bda-b073-02c52f0559f1'} Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:49:23.475354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:23.476578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:49:23.479407 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3695a61e-d425-4001-b636-41c4259949ac tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Returning 404 to user: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:49:23.480421 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3695a61e-d425-4001-b636-41c4259949ac tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 404 len: 111 microversion: 2.1 time: 0.054547 Jun 27 15:49:23.481092 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 93/193] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:49:23 2022] DELETE /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:49:23.490405 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-fcddcc3b-7f79-4f63-b0ef-f63bf72393a1 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:23.491063 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-fcddcc3b-7f79-4f63-b0ef-f63bf72393a1 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] [instance: 9b4fbc86-ac2c-4bda-b073-02c52f0559f1] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:23.497376 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fcddcc3b-7f79-4f63-b0ef-f63bf72393a1 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:23.498906 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fcddcc3b-7f79-4f63-b0ef-f63bf72393a1 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:23.499706 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fcddcc3b-7f79-4f63-b0ef-f63bf72393a1 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:23.500143 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fcddcc3b-7f79-4f63-b0ef-f63bf72393a1 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:23.516459 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-fcddcc3b-7f79-4f63-b0ef-f63bf72393a1 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] HTTP exception thrown: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-fcddcc3b-7f79-4f63-b0ef-f63bf72393a1 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Request method failure captured: Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 HTTP/1.1 Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudEuMFdTg4SwtnadhVoN894S0abD3Eo3QphkC9OCoc0jK6ao3L8vwWdj8vwMtu1px7kuU_YvoMDXkN8Q4EFfXswStjoaJ7k7RxbEmrZPw5Fzz0hdTSBkTup6v5f3shxY2YoyB7ciS8u5dy73rlZQt_yW5nClxQviB7S3__3g1QEJ1KA Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 2a805612e76c4f5e9052aa4a8ead24f1 Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-DeleteServersTestJSON-135659793 Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:49:23.518536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:49:23.519788 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a805612e76c4f5e9052aa4a8ead24f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2a805612e76c4f5e9052aa4a8ead24f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a805612e76c4f5e9052aa4a8ead24f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2a805612e76c4f5e9052aa4a8ead24f1", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:49:23.519788 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-DeleteServersTestJSON-135659793 Jun 27 15:49:23.519788 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 2a805612e76c4f5e9052aa4a8ead24f1 Jun 27 15:49:23.519788 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-DeleteServersTestJSON-135659793 Jun 27 15:49:23.519788 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-DeleteServersTestJSON-135659793-project Jun 27 15:49:23.519788 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:49:23.519788 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:49:23.519788 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 3520bd4387a140f88558d5f6fe55986e Jun 27 15:49:23.519788 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-DeleteServersTestJSON-135659793-project Jun 27 15:49:23.519788 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:49:23.519788 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:23.519788 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': '9b4fbc86-ac2c-4bda-b073-02c52f0559f1'} Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:49:23.521054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:49:23.526600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:49:23.526600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:49:23.526600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:49:23.526600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:49:23.526600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:49:23.526600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:49:23.526600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:49:23.526600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:23.526600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:23.526600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:49:23.526600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:23.526600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:49:23.526600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:49:23.526600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:49:23.526600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:49:23.526600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:49:23.526600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. Jun 27 15:49:23.526600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:23.527715 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-fcddcc3b-7f79-4f63-b0ef-f63bf72393a1 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] Returning 404 to user: Instance 9b4fbc86-ac2c-4bda-b073-02c52f0559f1 could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:49:23.527715 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-fcddcc3b-7f79-4f63-b0ef-f63bf72393a1 tempest-DeleteServersTestJSON-135659793 tempest-DeleteServersTestJSON-135659793-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1" status: 404 len: 111 microversion: 2.1 time: 0.034562 Jun 27 15:49:23.527715 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 101/194] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:23 2022] GET /compute/v2.1/servers/9b4fbc86-ac2c-4bda-b073-02c52f0559f1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:49:24.456802 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-29c3a2e3-5967-4604-88d3-f7f718fc425b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:24.457453 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-29c3a2e3-5967-4604-88d3-f7f718fc425b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:24.461380 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-5394aff1-da7b-49a2-afba-f19a63e3df46 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:24.462094 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-5394aff1-da7b-49a2-afba-f19a63e3df46 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:24.486686 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5394aff1-da7b-49a2-afba-f19a63e3df46 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:24.487206 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5394aff1-da7b-49a2-afba-f19a63e3df46 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:24.487905 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-29c3a2e3-5967-4604-88d3-f7f718fc425b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:24.488384 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-29c3a2e3-5967-4604-88d3-f7f718fc425b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:24.492177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-29c3a2e3-5967-4604-88d3-f7f718fc425b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:24.492634 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-29c3a2e3-5967-4604-88d3-f7f718fc425b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:24.497141 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5394aff1-da7b-49a2-afba-f19a63e3df46 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:24.497602 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5394aff1-da7b-49a2-afba-f19a63e3df46 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:24.817609 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-5394aff1-da7b-49a2-afba-f19a63e3df46 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:24.831434 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-5394aff1-da7b-49a2-afba-f19a63e3df46 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.394238 Jun 27 15:49:24.843335 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 94/195] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:24 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:24.864301 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-29c3a2e3-5967-4604-88d3-f7f718fc425b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364c6c6f607045d988dd55d8f467b027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009dfcdbdd3840189d5222ff1606f4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:24.874627 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-29c3a2e3-5967-4604-88d3-f7f718fc425b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc" status: 200 len: 1465 microversion: 2.1 time: 0.434153 Jun 27 15:49:24.875209 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 102/196] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:24 2022] GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc => generated 1465 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:24.929367 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8f18a0c2-268b-4c89-8098-8f627d9bbb36 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:24.929914 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8f18a0c2-268b-4c89-8098-8f627d9bbb36 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:24.940751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8f18a0c2-268b-4c89-8098-8f627d9bbb36 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:24.941555 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8f18a0c2-268b-4c89-8098-8f627d9bbb36 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:24.944460 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8f18a0c2-268b-4c89-8098-8f627d9bbb36 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:24.945081 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8f18a0c2-268b-4c89-8098-8f627d9bbb36 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:24.998352 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8f18a0c2-268b-4c89-8098-8f627d9bbb36 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Going to try to terminate instance {{(pid=129472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:49:25.200676 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-8f18a0c2-268b-4c89-8098-8f627d9bbb36 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc" status: 204 len: 0 microversion: 2.1 time: 0.274778 Jun 27 15:49:25.201578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 95/197] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:49:24 2022] DELETE /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:49:25.213033 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-fcd63033-4d65-4a6d-a4a2-00368cad539b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:25.214603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-fcd63033-4d65-4a6d-a4a2-00368cad539b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:25.232173 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fcd63033-4d65-4a6d-a4a2-00368cad539b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:25.232548 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fcd63033-4d65-4a6d-a4a2-00368cad539b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:25.233343 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fcd63033-4d65-4a6d-a4a2-00368cad539b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:25.238023 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fcd63033-4d65-4a6d-a4a2-00368cad539b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:25.497973 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-fcd63033-4d65-4a6d-a4a2-00368cad539b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364c6c6f607045d988dd55d8f467b027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009dfcdbdd3840189d5222ff1606f4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:25.528854 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-fcd63033-4d65-4a6d-a4a2-00368cad539b tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc" status: 200 len: 1471 microversion: 2.1 time: 0.320871 Jun 27 15:49:25.532800 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 103/198] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:25 2022] GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc => generated 1471 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:25.854890 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-581baa82-13f2-4a96-976a-9cb6376b153e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:25.856566 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-581baa82-13f2-4a96-976a-9cb6376b153e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:25.874409 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-581baa82-13f2-4a96-976a-9cb6376b153e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:25.875224 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-581baa82-13f2-4a96-976a-9cb6376b153e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:25.876870 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-581baa82-13f2-4a96-976a-9cb6376b153e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:25.877549 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-581baa82-13f2-4a96-976a-9cb6376b153e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:26.550089 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-264f5363-1989-4130-880a-a477f175cbf4 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:26.551490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-264f5363-1989-4130-880a-a477f175cbf4 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:26.557874 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-264f5363-1989-4130-880a-a477f175cbf4 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:26.558624 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-264f5363-1989-4130-880a-a477f175cbf4 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:26.559641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-264f5363-1989-4130-880a-a477f175cbf4 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:26.560305 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-264f5363-1989-4130-880a-a477f175cbf4 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:26.565018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-581baa82-13f2-4a96-976a-9cb6376b153e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:26.576042 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-581baa82-13f2-4a96-976a-9cb6376b153e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.729319 Jun 27 15:49:26.580318 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 96/199] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:25 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:26.953324 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-264f5363-1989-4130-880a-a477f175cbf4 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364c6c6f607045d988dd55d8f467b027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009dfcdbdd3840189d5222ff1606f4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:26.979357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-264f5363-1989-4130-880a-a477f175cbf4 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc" status: 200 len: 1471 microversion: 2.1 time: 0.430707 Jun 27 15:49:26.982034 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 104/200] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:26 2022] GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc => generated 1471 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:27.599209 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-fdee1370-e3a4-4121-b884-44913c1e304f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:27.602009 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-fdee1370-e3a4-4121-b884-44913c1e304f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:27.630112 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fdee1370-e3a4-4121-b884-44913c1e304f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:27.633156 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fdee1370-e3a4-4121-b884-44913c1e304f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:27.634241 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fdee1370-e3a4-4121-b884-44913c1e304f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:27.636800 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fdee1370-e3a4-4121-b884-44913c1e304f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:27.939327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-fdee1370-e3a4-4121-b884-44913c1e304f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:27.948325 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-fdee1370-e3a4-4121-b884-44913c1e304f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.355429 Jun 27 15:49:27.959682 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 97/201] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:27 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:28.015036 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d267a825-121b-4e4f-8ad0-71288135de51 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:28.017513 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d267a825-121b-4e4f-8ad0-71288135de51 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:28.029931 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d267a825-121b-4e4f-8ad0-71288135de51 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:28.031789 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d267a825-121b-4e4f-8ad0-71288135de51 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:28.033058 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d267a825-121b-4e4f-8ad0-71288135de51 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:28.034851 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d267a825-121b-4e4f-8ad0-71288135de51 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:28.214183 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d267a825-121b-4e4f-8ad0-71288135de51 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364c6c6f607045d988dd55d8f467b027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009dfcdbdd3840189d5222ff1606f4fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:28.224901 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d267a825-121b-4e4f-8ad0-71288135de51 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc" status: 200 len: 1429 microversion: 2.1 time: 0.230057 Jun 27 15:49:28.225951 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 105/202] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:27 2022] GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc => generated 1429 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:28.263579 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-df8638d7-6623-499c-8280-89abc29055be req-1da8ec8b-3294-498a-8694-10264cf8f8fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc", "name": "network-vif-deleted", "tag": "18582df6-8cc0-42c2-ad82-f13300fb3449"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:49:28.268828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:49:28.312550 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-df8638d7-6623-499c-8280-89abc29055be req-1da8ec8b-3294-498a-8694-10264cf8f8fb service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:28.312996 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-df8638d7-6623-499c-8280-89abc29055be req-1da8ec8b-3294-498a-8694-10264cf8f8fb service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:28.330456 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-df8638d7-6623-499c-8280-89abc29055be req-1da8ec8b-3294-498a-8694-10264cf8f8fb service nova] Creating event network-vif-deleted:18582df6-8cc0-42c2-ad82-f13300fb3449 for instance ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc on hv-cinder-84780 Jun 27 15:49:28.344736 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-df8638d7-6623-499c-8280-89abc29055be req-1da8ec8b-3294-498a-8694-10264cf8f8fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084623 Jun 27 15:49:28.351916 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 98/203] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:49:28.967718 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-af923bac-0363-4299-a08f-d25d8d398ee1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:28.970856 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-af923bac-0363-4299-a08f-d25d8d398ee1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:28.986091 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-af923bac-0363-4299-a08f-d25d8d398ee1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:28.989526 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-af923bac-0363-4299-a08f-d25d8d398ee1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:28.994387 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-af923bac-0363-4299-a08f-d25d8d398ee1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:28.995261 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-af923bac-0363-4299-a08f-d25d8d398ee1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:29.072338 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-bc1c4223-6898-4d8c-a101-db8a32dc1b78 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-103275675", "imageRef": "11f9be98-90d6-4c67-8d66-0b944f5a2a2b", "flavorRef": "452", "networks": [{"uuid": "0821cc96-fee1-43a4-9f94-ea18f3f4f2f5"}]}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:49:29.170692 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.network.neutron [None req-bc1c4223-6898-4d8c-a101-db8a32dc1b78 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] validate_networks() for [('0821cc96-fee1-43a4-9f94-ea18f3f4f2f5', None, None, None, None, None)] {{(pid=129472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:49:29.452705 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-af923bac-0363-4299-a08f-d25d8d398ee1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:29.463841 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-af923bac-0363-4299-a08f-d25d8d398ee1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.500626 Jun 27 15:49:29.466095 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 106/204] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:28 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:29.471652 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ed0a9975-e2dc-4322-9de3-296217c8f639 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:29.472491 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-ed0a9975-e2dc-4322-9de3-296217c8f639 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] [instance: ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:29.479394 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ed0a9975-e2dc-4322-9de3-296217c8f639 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:29.480711 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ed0a9975-e2dc-4322-9de3-296217c8f639 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:29.481680 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ed0a9975-e2dc-4322-9de3-296217c8f639 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:29.482268 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ed0a9975-e2dc-4322-9de3-296217c8f639 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:29.505197 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-ed0a9975-e2dc-4322-9de3-296217c8f639 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] HTTP exception thrown: Instance ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc could not be found. Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ed0a9975-e2dc-4322-9de3-296217c8f639 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Request method failure captured: Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc HTTP/1.1 Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudFwZSljdRmsreTlfX_r8rODpK5_vIdVdHJBKa2ZYvj9fFqTZ6JYKOQO3TlZYpn-7NjH5td6sqbV0Ba_fzpx4zw9tQkMDHEUPUuD9j-RjAY_-2b2Yg--bm22IbU5tgpzw1Jw0WdgWimgPHHZ0qvaIGXvr3ayeWPf2Fo9cPeo60vte-0 Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 009dfcdbdd3840189d5222ff1606f4fa Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-VolumesNegativeTest-1192218059 Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:49:29.507248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:49:29.508603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/009dfcdbdd3840189d5222ff1606f4fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/009dfcdbdd3840189d5222ff1606f4fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/009dfcdbdd3840189d5222ff1606f4fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_009dfcdbdd3840189d5222ff1606f4fa", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:49:29.508603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-VolumesNegativeTest-1192218059 Jun 27 15:49:29.508603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 009dfcdbdd3840189d5222ff1606f4fa Jun 27 15:49:29.508603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-VolumesNegativeTest-1192218059 Jun 27 15:49:29.508603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-VolumesNegativeTest-1192218059-project Jun 27 15:49:29.508603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:49:29.508603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:49:29.508603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 364c6c6f607045d988dd55d8f467b027 Jun 27 15:49:29.508603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-VolumesNegativeTest-1192218059-project Jun 27 15:49:29.508603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:49:29.508603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc could not be found. Jun 27 15:49:29.508603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': 'ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc'} Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc could not be found. Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:49:29.509414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:49:29.510699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:49:29.510699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:49:29.510699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:49:29.510699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:49:29.510699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:49:29.510699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:49:29.510699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:49:29.510699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc could not be found. Jun 27 15:49:29.510699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:29.510699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:49:29.510699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:29.510699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:49:29.510699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:49:29.510699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:49:29.510699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:49:29.510699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:49:29.510699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc could not be found. Jun 27 15:49:29.510699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:49:29.527921 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ed0a9975-e2dc-4322-9de3-296217c8f639 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] Returning 404 to user: Instance ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:49:29.529104 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-ed0a9975-e2dc-4322-9de3-296217c8f639 tempest-VolumesNegativeTest-1192218059 tempest-VolumesNegativeTest-1192218059-project] 10.222.0.20 "GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc" status: 404 len: 111 microversion: 2.1 time: 0.061679 Jun 27 15:49:29.529975 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 107/205] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:29 2022] GET /compute/v2.1/servers/ee18fdf7-f699-4ad1-a787-9de2c6f2e9cc => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:49:29.790553 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-bc1c4223-6898-4d8c-a101-db8a32dc1b78 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Flavor limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:49:29.790961 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-bc1c4223-6898-4d8c-a101-db8a32dc1b78 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Image limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:49:29.791516 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-bc1c4223-6898-4d8c-a101-db8a32dc1b78 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Flavor pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:49:29.791928 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-bc1c4223-6898-4d8c-a101-db8a32dc1b78 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Image pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:49:29.792348 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-bc1c4223-6898-4d8c-a101-db8a32dc1b78 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:49:29.804658 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bc1c4223-6898-4d8c-a101-db8a32dc1b78 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:29.805294 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bc1c4223-6898-4d8c-a101-db8a32dc1b78 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:29.806170 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bc1c4223-6898-4d8c-a101-db8a32dc1b78 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:29.806798 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bc1c4223-6898-4d8c-a101-db8a32dc1b78 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:29.839542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-bc1c4223-6898-4d8c-a101-db8a32dc1b78 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Getting quotas for project e552ed97892f41259a1d7057aea64f6b. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:49:29.848425 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-bc1c4223-6898-4d8c-a101-db8a32dc1b78 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Getting quotas for user 7432931bd04d45bcaee686df05d5c5b3 and project e552ed97892f41259a1d7057aea64f6b. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:49:29.863664 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-bc1c4223-6898-4d8c-a101-db8a32dc1b78 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Going to run 1 instances... {{(pid=129472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:49:29.867488 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-bc1c4223-6898-4d8c-a101-db8a32dc1b78 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11f9be98-90d6-4c67-8d66-0b944f5a2a2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:49:29.977808 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-bc1c4223-6898-4d8c-a101-db8a32dc1b78 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.905809 Jun 27 15:49:29.981842 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 99/206] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 15:49:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:49:29.994696 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-1e52be28-37c3-4c07-beed-145e21df179c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:29.995320 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-1e52be28-37c3-4c07-beed-145e21df179c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:30.099594 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-1e52be28-37c3-4c07-beed-145e21df179c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:30.107563 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-1e52be28-37c3-4c07-beed-145e21df179c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1218 microversion: 2.1 time: 0.122898 Jun 27 15:49:30.109779 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 108/207] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:29 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:30.486423 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-af40918b-f4dd-4fa2-8aea-d3ab142382ff tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:30.489590 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-af40918b-f4dd-4fa2-8aea-d3ab142382ff tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:30.501873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-af40918b-f4dd-4fa2-8aea-d3ab142382ff tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:30.502770 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-af40918b-f4dd-4fa2-8aea-d3ab142382ff tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:30.503858 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-af40918b-f4dd-4fa2-8aea-d3ab142382ff tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:30.505299 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-af40918b-f4dd-4fa2-8aea-d3ab142382ff tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:30.710488 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-af40918b-f4dd-4fa2-8aea-d3ab142382ff tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:30.719184 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-af40918b-f4dd-4fa2-8aea-d3ab142382ff tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.239126 Jun 27 15:49:30.730230 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 100/208] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:30 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:31.126406 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-80f3b332-bb76-4062-8e86-62ed7771c0d4 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:31.126406 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-80f3b332-bb76-4062-8e86-62ed7771c0d4 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:31.133293 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-80f3b332-bb76-4062-8e86-62ed7771c0d4 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:31.133942 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-80f3b332-bb76-4062-8e86-62ed7771c0d4 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:31.134763 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-80f3b332-bb76-4062-8e86-62ed7771c0d4 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:31.135332 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-80f3b332-bb76-4062-8e86-62ed7771c0d4 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:31.205312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-80f3b332-bb76-4062-8e86-62ed7771c0d4 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:31.220726 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-80f3b332-bb76-4062-8e86-62ed7771c0d4 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1270 microversion: 2.1 time: 0.099979 Jun 27 15:49:31.222250 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 109/209] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:31 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:31.741759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-cb68d9de-8310-4ce3-a01d-a5a2415f919d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:31.741759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-cb68d9de-8310-4ce3-a01d-a5a2415f919d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:31.747808 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cb68d9de-8310-4ce3-a01d-a5a2415f919d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:31.749132 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cb68d9de-8310-4ce3-a01d-a5a2415f919d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:31.750280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cb68d9de-8310-4ce3-a01d-a5a2415f919d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:31.758257 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cb68d9de-8310-4ce3-a01d-a5a2415f919d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:32.101469 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-cb68d9de-8310-4ce3-a01d-a5a2415f919d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:32.111580 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-cb68d9de-8310-4ce3-a01d-a5a2415f919d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.376701 Jun 27 15:49:32.117048 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 101/210] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:31 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:32.239843 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-8007a956-8361-406f-a99e-8fcd0c6c5adb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:32.241390 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-8007a956-8361-406f-a99e-8fcd0c6c5adb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:32.252367 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8007a956-8361-406f-a99e-8fcd0c6c5adb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:32.254849 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8007a956-8361-406f-a99e-8fcd0c6c5adb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:32.257056 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8007a956-8361-406f-a99e-8fcd0c6c5adb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:32.259456 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8007a956-8361-406f-a99e-8fcd0c6c5adb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:32.515395 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-8007a956-8361-406f-a99e-8fcd0c6c5adb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:32.524494 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-8007a956-8361-406f-a99e-8fcd0c6c5adb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1318 microversion: 2.1 time: 0.289017 Jun 27 15:49:32.525194 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 110/211] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:32 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:33.135315 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-da2b5aa4-319c-47e0-b5af-c39e4fbd5b88 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:33.136539 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-da2b5aa4-319c-47e0-b5af-c39e4fbd5b88 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:33.157248 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-da2b5aa4-319c-47e0-b5af-c39e4fbd5b88 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:33.158108 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-da2b5aa4-319c-47e0-b5af-c39e4fbd5b88 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:33.159208 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-da2b5aa4-319c-47e0-b5af-c39e4fbd5b88 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:33.159858 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-da2b5aa4-319c-47e0-b5af-c39e4fbd5b88 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:33.350706 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-da2b5aa4-319c-47e0-b5af-c39e4fbd5b88 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:33.362464 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-da2b5aa4-319c-47e0-b5af-c39e4fbd5b88 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.231090 Jun 27 15:49:33.363698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 102/212] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:33 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:33.549130 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-039ec2b0-ad81-417f-935c-52c6789affdd tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:33.549770 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-039ec2b0-ad81-417f-935c-52c6789affdd tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:33.556633 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-039ec2b0-ad81-417f-935c-52c6789affdd tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:33.557350 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-039ec2b0-ad81-417f-935c-52c6789affdd tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:33.558531 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-039ec2b0-ad81-417f-935c-52c6789affdd tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:33.559128 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-039ec2b0-ad81-417f-935c-52c6789affdd tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:33.814416 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-039ec2b0-ad81-417f-935c-52c6789affdd tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:33.842885 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-039ec2b0-ad81-417f-935c-52c6789affdd tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1318 microversion: 2.1 time: 0.299749 Jun 27 15:49:33.850531 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 111/213] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:33 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:34.030836 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-da2ddc74-9777-4b50-a082-c658020bd80f req-27f5dce6-4df0-433e-a418-39f259bc9d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49d4234-4e82-48ef-985d-fa848a6856f7", "tag": "9e89bfc5-9bbf-4ad7-82cc-2097bfc80839"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:49:34.051047 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-da2ddc74-9777-4b50-a082-c658020bd80f req-27f5dce6-4df0-433e-a418-39f259bc9d22 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:34.056002 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-da2ddc74-9777-4b50-a082-c658020bd80f req-27f5dce6-4df0-433e-a418-39f259bc9d22 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:34.087286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-da2ddc74-9777-4b50-a082-c658020bd80f req-27f5dce6-4df0-433e-a418-39f259bc9d22 service nova] Creating event network-changed:9e89bfc5-9bbf-4ad7-82cc-2097bfc80839 for instance d49d4234-4e82-48ef-985d-fa848a6856f7 on hv-cinder-84780 Jun 27 15:49:34.092297 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-da2ddc74-9777-4b50-a082-c658020bd80f req-27f5dce6-4df0-433e-a418-39f259bc9d22 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075938 Jun 27 15:49:34.092965 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 103/214] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:49:34.386332 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-7ac73cd5-62ab-4c8f-9c37-803aa603d425 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:34.387557 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-7ac73cd5-62ab-4c8f-9c37-803aa603d425 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:34.402328 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7ac73cd5-62ab-4c8f-9c37-803aa603d425 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:34.403030 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7ac73cd5-62ab-4c8f-9c37-803aa603d425 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:34.404031 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7ac73cd5-62ab-4c8f-9c37-803aa603d425 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:34.404713 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7ac73cd5-62ab-4c8f-9c37-803aa603d425 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:34.424960 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=100 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:49:34.585684 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-7ac73cd5-62ab-4c8f-9c37-803aa603d425 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:34.595396 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-7ac73cd5-62ab-4c8f-9c37-803aa603d425 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.214013 Jun 27 15:49:34.596735 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 112/215] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:34 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:34.872482 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-4e62d2c8-5886-4a33-923a-eb275ffea8fb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:34.873955 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-4e62d2c8-5886-4a33-923a-eb275ffea8fb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:34.885385 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4e62d2c8-5886-4a33-923a-eb275ffea8fb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:34.885865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4e62d2c8-5886-4a33-923a-eb275ffea8fb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:34.886917 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4e62d2c8-5886-4a33-923a-eb275ffea8fb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:34.887588 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4e62d2c8-5886-4a33-923a-eb275ffea8fb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:35.065173 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-4e62d2c8-5886-4a33-923a-eb275ffea8fb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:35.073842 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-4e62d2c8-5886-4a33-923a-eb275ffea8fb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1318 microversion: 2.1 time: 0.211184 Jun 27 15:49:35.075132 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 104/216] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:34 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:35.620361 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-5fe97684-af77-42e1-bd75-bfda0795b487 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:35.623117 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-5fe97684-af77-42e1-bd75-bfda0795b487 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:35.636915 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5fe97684-af77-42e1-bd75-bfda0795b487 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:35.638216 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5fe97684-af77-42e1-bd75-bfda0795b487 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:35.639991 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5fe97684-af77-42e1-bd75-bfda0795b487 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:35.641088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5fe97684-af77-42e1-bd75-bfda0795b487 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:35.919611 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-5fe97684-af77-42e1-bd75-bfda0795b487 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:35.939692 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-5fe97684-af77-42e1-bd75-bfda0795b487 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.328196 Jun 27 15:49:35.942706 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 113/217] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:35 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:36.091680 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-952f47e2-cca3-4f47-bf60-d7d17e1d6c45 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:36.092892 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-952f47e2-cca3-4f47-bf60-d7d17e1d6c45 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:36.100240 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-952f47e2-cca3-4f47-bf60-d7d17e1d6c45 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:36.100838 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-952f47e2-cca3-4f47-bf60-d7d17e1d6c45 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:36.102192 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-952f47e2-cca3-4f47-bf60-d7d17e1d6c45 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:36.102192 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-952f47e2-cca3-4f47-bf60-d7d17e1d6c45 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:36.348676 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-952f47e2-cca3-4f47-bf60-d7d17e1d6c45 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:36.362080 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-952f47e2-cca3-4f47-bf60-d7d17e1d6c45 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1318 microversion: 2.1 time: 0.274168 Jun 27 15:49:36.363302 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 105/218] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:36 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:36.959568 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ca9b1cf9-bbd6-4807-b408-a49e020ec53e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:36.960371 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-ca9b1cf9-bbd6-4807-b408-a49e020ec53e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:36.974036 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ca9b1cf9-bbd6-4807-b408-a49e020ec53e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:36.974769 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ca9b1cf9-bbd6-4807-b408-a49e020ec53e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:36.975744 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ca9b1cf9-bbd6-4807-b408-a49e020ec53e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:36.977707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ca9b1cf9-bbd6-4807-b408-a49e020ec53e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:37.262578 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-ca9b1cf9-bbd6-4807-b408-a49e020ec53e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:37.274656 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-ca9b1cf9-bbd6-4807-b408-a49e020ec53e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.319075 Jun 27 15:49:37.275997 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 114/219] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:36 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:37.384717 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-91c06b09-7657-4d55-8415-5e027fc2c23a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:37.385417 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-91c06b09-7657-4d55-8415-5e027fc2c23a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:37.395805 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-91c06b09-7657-4d55-8415-5e027fc2c23a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:37.401523 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-91c06b09-7657-4d55-8415-5e027fc2c23a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:37.403279 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-91c06b09-7657-4d55-8415-5e027fc2c23a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:37.405258 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-91c06b09-7657-4d55-8415-5e027fc2c23a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:37.633500 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-91c06b09-7657-4d55-8415-5e027fc2c23a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:37.645824 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-91c06b09-7657-4d55-8415-5e027fc2c23a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1318 microversion: 2.1 time: 0.266902 Jun 27 15:49:37.657362 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 106/220] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:37 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:38.295104 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-6b3e0cef-0495-4505-ae6d-94fc3a32fa10 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:38.302524 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-6b3e0cef-0495-4505-ae6d-94fc3a32fa10 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:38.315334 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6b3e0cef-0495-4505-ae6d-94fc3a32fa10 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:38.315793 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6b3e0cef-0495-4505-ae6d-94fc3a32fa10 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:38.318821 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6b3e0cef-0495-4505-ae6d-94fc3a32fa10 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:38.319276 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6b3e0cef-0495-4505-ae6d-94fc3a32fa10 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:38.610265 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-6b3e0cef-0495-4505-ae6d-94fc3a32fa10 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:38.622593 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-6b3e0cef-0495-4505-ae6d-94fc3a32fa10 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.332085 Jun 27 15:49:38.624410 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 115/221] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:38 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:38.662658 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-230a1faa-5824-45d0-b4f3-b63286b3e9b9 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:38.663271 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-230a1faa-5824-45d0-b4f3-b63286b3e9b9 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:38.675337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-230a1faa-5824-45d0-b4f3-b63286b3e9b9 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:38.677441 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-230a1faa-5824-45d0-b4f3-b63286b3e9b9 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:38.678931 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-230a1faa-5824-45d0-b4f3-b63286b3e9b9 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:38.680293 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-230a1faa-5824-45d0-b4f3-b63286b3e9b9 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:38.958973 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-230a1faa-5824-45d0-b4f3-b63286b3e9b9 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:38.967757 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-230a1faa-5824-45d0-b4f3-b63286b3e9b9 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1318 microversion: 2.1 time: 0.308669 Jun 27 15:49:38.968897 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 107/222] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:38 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:39.610847 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-47261f30-d510-439b-ad8e-4db727e55782 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Action: 'create', calling method: .version_select at 0x7fe146ded550>, body: {"keypair": {"name": "tempest-keypair-1963151989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3gCpKIdplOPDsOELmvjv/+iWZD6emNxIM6oVhCBkK34VuR8V9lp+bwZXHKUbmR0njhXVn3tI4LUhmfa+OFRn4J6RbbXCAZ6Ed9AzEPtGANODa2Ou4CnzoHKvh8oJJH0Q=="}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:49:39.635102 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-47261f30-d510-439b-ad8e-4db727e55782 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Getting quotas for project 5d416620e9f942ab9f76e6b117cd8b61. Resources: {'key_pairs'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:49:39.641334 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d7b601fe-87e4-47d2-a41d-ecf1af3d376f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:39.642577 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d7b601fe-87e4-47d2-a41d-ecf1af3d376f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:39.647141 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-47261f30-d510-439b-ad8e-4db727e55782 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Getting quotas for user 6890639a0a2e4ca9b103919fdbbffc5b and project 5d416620e9f942ab9f76e6b117cd8b61. Resources: {'key_pairs'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:49:39.650768 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d7b601fe-87e4-47d2-a41d-ecf1af3d376f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:39.651463 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d7b601fe-87e4-47d2-a41d-ecf1af3d376f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:39.652559 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d7b601fe-87e4-47d2-a41d-ecf1af3d376f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:39.653314 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d7b601fe-87e4-47d2-a41d-ecf1af3d376f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:39.675964 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:49:39.733128 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-47261f30-d510-439b-ad8e-4db727e55782 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.372211 Jun 27 15:49:39.734094 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 116/223] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Jun 27 15:49:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 374 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 27 15:49:39.829773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=2 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:49:39.849496 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d7b601fe-87e4-47d2-a41d-ecf1af3d376f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:39.858536 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d7b601fe-87e4-47d2-a41d-ecf1af3d376f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1522 microversion: 2.1 time: 0.220406 Jun 27 15:49:39.861628 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 108/224] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:39 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:39.986959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-1d09101b-eac2-4ac5-ab29-441ac504c827 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:39.987739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-1d09101b-eac2-4ac5-ab29-441ac504c827 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:39.997031 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1d09101b-eac2-4ac5-ab29-441ac504c827 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:39.997770 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1d09101b-eac2-4ac5-ab29-441ac504c827 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:39.998825 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1d09101b-eac2-4ac5-ab29-441ac504c827 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:39.999861 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1d09101b-eac2-4ac5-ab29-441ac504c827 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:40.236018 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-1d09101b-eac2-4ac5-ab29-441ac504c827 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:40.248034 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-1d09101b-eac2-4ac5-ab29-441ac504c827 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1318 microversion: 2.1 time: 0.265801 Jun 27 15:49:40.249952 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 117/225] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:39 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:40.877124 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3ec9b5d5-86c9-4e6a-989b-92f7be04382c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:40.877768 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3ec9b5d5-86c9-4e6a-989b-92f7be04382c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:40.880209 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=6 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:49:40.891716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3ec9b5d5-86c9-4e6a-989b-92f7be04382c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:40.893765 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3ec9b5d5-86c9-4e6a-989b-92f7be04382c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:40.895373 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3ec9b5d5-86c9-4e6a-989b-92f7be04382c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:40.897154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3ec9b5d5-86c9-4e6a-989b-92f7be04382c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:41.254671 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3ec9b5d5-86c9-4e6a-989b-92f7be04382c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:41.269351 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3ec9b5d5-86c9-4e6a-989b-92f7be04382c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1502 microversion: 2.1 time: 0.396202 Jun 27 15:49:41.276519 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-7496cd85-4704-4b1c-bf53-6a3a85135e03 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:41.279734 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-7496cd85-4704-4b1c-bf53-6a3a85135e03 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:41.297622 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 109/226] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:40 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1502 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:41.301335 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7496cd85-4704-4b1c-bf53-6a3a85135e03 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:41.307278 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7496cd85-4704-4b1c-bf53-6a3a85135e03 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:41.308199 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7496cd85-4704-4b1c-bf53-6a3a85135e03 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:41.308653 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7496cd85-4704-4b1c-bf53-6a3a85135e03 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:41.311711 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9c33421c-5cdf-445b-8fad-e6275764a1ed tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:41.315846 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9c33421c-5cdf-445b-8fad-e6275764a1ed tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:41.348398 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9c33421c-5cdf-445b-8fad-e6275764a1ed tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:41.349383 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9c33421c-5cdf-445b-8fad-e6275764a1ed tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:41.356612 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9c33421c-5cdf-445b-8fad-e6275764a1ed tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:41.357245 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9c33421c-5cdf-445b-8fad-e6275764a1ed tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:41.745748 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-7496cd85-4704-4b1c-bf53-6a3a85135e03 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:41.749573 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9c33421c-5cdf-445b-8fad-e6275764a1ed tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:41.761023 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-7496cd85-4704-4b1c-bf53-6a3a85135e03 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1318 microversion: 2.1 time: 0.488838 Jun 27 15:49:41.762379 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 118/227] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:41 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:41.768967 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9c33421c-5cdf-445b-8fad-e6275764a1ed tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1516 microversion: 2.1 time: 0.465512 Jun 27 15:49:41.769171 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 110/228] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:41 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1516 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:42.772730 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-6a895344-8431-4ee6-8589-2d70c081c7c9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2030718825", "imageRef": "11f9be98-90d6-4c67-8d66-0b944f5a2a2b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e01f7daa-9879-48a7-a8dc-d6cb6ac6f291"}], "security_groups": [{"name": "tempest-securitygroup--639335781"}], "key_name": "tempest-keypair-1963151989", "user_data": "}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:49:42.778782 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-e4ef0bcd-a559-4497-94a3-0a1477d733ef tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:42.779436 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-e4ef0bcd-a559-4497-94a3-0a1477d733ef tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:42.787339 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e4ef0bcd-a559-4497-94a3-0a1477d733ef tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:42.788098 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e4ef0bcd-a559-4497-94a3-0a1477d733ef tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:42.789241 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e4ef0bcd-a559-4497-94a3-0a1477d733ef tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:42.789867 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e4ef0bcd-a559-4497-94a3-0a1477d733ef tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:42.984397 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.network.neutron [None req-6a895344-8431-4ee6-8589-2d70c081c7c9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] validate_networks() for [('e01f7daa-9879-48a7-a8dc-d6cb6ac6f291', None, None, None, None, None)] {{(pid=129473) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:49:43.060115 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-e4ef0bcd-a559-4497-94a3-0a1477d733ef tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:43.074776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-e4ef0bcd-a559-4497-94a3-0a1477d733ef tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1318 microversion: 2.1 time: 0.300582 Jun 27 15:49:43.075438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 111/229] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:42 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:43.498613 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-6a895344-8431-4ee6-8589-2d70c081c7c9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Flavor limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:49:43.499142 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-6a895344-8431-4ee6-8589-2d70c081c7c9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Image limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:49:43.499615 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-6a895344-8431-4ee6-8589-2d70c081c7c9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Flavor pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:49:43.500018 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-6a895344-8431-4ee6-8589-2d70c081c7c9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Image pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:49:43.500585 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-6a895344-8431-4ee6-8589-2d70c081c7c9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:49:43.511265 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6a895344-8431-4ee6-8589-2d70c081c7c9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:43.511713 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6a895344-8431-4ee6-8589-2d70c081c7c9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:43.512524 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6a895344-8431-4ee6-8589-2d70c081c7c9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:43.512963 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6a895344-8431-4ee6-8589-2d70c081c7c9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:43.531816 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-6a895344-8431-4ee6-8589-2d70c081c7c9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Getting quotas for project 5d416620e9f942ab9f76e6b117cd8b61. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:49:43.536273 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-6a895344-8431-4ee6-8589-2d70c081c7c9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Getting quotas for user 6890639a0a2e4ca9b103919fdbbffc5b and project 5d416620e9f942ab9f76e6b117cd8b61. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:49:43.550056 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-6a895344-8431-4ee6-8589-2d70c081c7c9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Going to run 1 instances... {{(pid=129473) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:49:43.553243 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-6a895344-8431-4ee6-8589-2d70c081c7c9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11f9be98-90d6-4c67-8d66-0b944f5a2a2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:49:43.603982 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-6a895344-8431-4ee6-8589-2d70c081c7c9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.839519 Jun 27 15:49:43.604641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 119/230] 10.222.0.20 () {62 vars in 1187 bytes} [Mon Jun 27 15:49:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 27 15:49:43.618112 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-7d6ec784-03d1-4157-baab-2c96410a8145 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:43.618738 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-7d6ec784-03d1-4157-baab-2c96410a8145 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:43.680965 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-7d6ec784-03d1-4157-baab-2c96410a8145 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:43.689461 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-7d6ec784-03d1-4157-baab-2c96410a8145 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:43.691305 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-7d6ec784-03d1-4157-baab-2c96410a8145 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:43.693898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-7d6ec784-03d1-4157-baab-2c96410a8145 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1282 microversion: 2.20 time: 0.081662 Jun 27 15:49:43.703685 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 112/231] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:49:43 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:49:44.092397 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0ae11564-3e7e-4263-bc68-a94c8476c37a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:44.093041 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-0ae11564-3e7e-4263-bc68-a94c8476c37a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:44.099864 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0ae11564-3e7e-4263-bc68-a94c8476c37a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:44.100331 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0ae11564-3e7e-4263-bc68-a94c8476c37a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:44.101189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0ae11564-3e7e-4263-bc68-a94c8476c37a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:44.101548 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0ae11564-3e7e-4263-bc68-a94c8476c37a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:44.263314 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-0ae11564-3e7e-4263-bc68-a94c8476c37a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:44.274997 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-0ae11564-3e7e-4263-bc68-a94c8476c37a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1318 microversion: 2.1 time: 0.185807 Jun 27 15:49:44.276458 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 120/232] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:44 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:44.419949 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-4b1c1e09-448e-4aac-aeea-9008beb55ac4 req-3512efad-e24e-4bec-8c9e-140b5990c6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49d4234-4e82-48ef-985d-fa848a6856f7", "name": "network-vif-plugged", "status": "completed", "tag": "9e89bfc5-9bbf-4ad7-82cc-2097bfc80839"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:49:44.431803 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-4b1c1e09-448e-4aac-aeea-9008beb55ac4 req-3512efad-e24e-4bec-8c9e-140b5990c6fb service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:44.432484 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-4b1c1e09-448e-4aac-aeea-9008beb55ac4 req-3512efad-e24e-4bec-8c9e-140b5990c6fb service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:44.444183 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-4b1c1e09-448e-4aac-aeea-9008beb55ac4 req-3512efad-e24e-4bec-8c9e-140b5990c6fb service nova] Creating event network-vif-plugged:9e89bfc5-9bbf-4ad7-82cc-2097bfc80839 for instance d49d4234-4e82-48ef-985d-fa848a6856f7 on hv-cinder-84780 Jun 27 15:49:44.450323 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-4b1c1e09-448e-4aac-aeea-9008beb55ac4 req-3512efad-e24e-4bec-8c9e-140b5990c6fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034288 Jun 27 15:49:44.454648 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 113/233] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:49:44.521568 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-674792c6-c120-428b-acbd-e1d74335c270 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:49:44.523016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-674792c6-c120-428b-acbd-e1d74335c270 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:44.529799 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-674792c6-c120-428b-acbd-e1d74335c270 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:44.530243 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-674792c6-c120-428b-acbd-e1d74335c270 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:44.531187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-674792c6-c120-428b-acbd-e1d74335c270 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:44.531650 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-674792c6-c120-428b-acbd-e1d74335c270 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:44.558714 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.objects.instance [None req-674792c6-c120-428b-acbd-e1d74335c270 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lazy-loading 'flavor' on Instance uuid 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 {{(pid=129473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:49:44.648826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-674792c6-c120-428b-acbd-e1d74335c270 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "POST /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5/action" status: 200 len: 32 microversion: 2.1 time: 0.132079 Jun 27 15:49:44.649484 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 121/234] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 27 15:49:44 2022] POST /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5/action => generated 32 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 15:49:44.663380 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-b499f70b-2b8e-4afa-b58d-e4279eeb110b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:44.664060 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-b499f70b-2b8e-4afa-b58d-e4279eeb110b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:44.671926 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b499f70b-2b8e-4afa-b58d-e4279eeb110b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:44.672490 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b499f70b-2b8e-4afa-b58d-e4279eeb110b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:44.673518 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b499f70b-2b8e-4afa-b58d-e4279eeb110b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:44.674047 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b499f70b-2b8e-4afa-b58d-e4279eeb110b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:44.710644 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b316b311-2651-4f1d-8016-ae7944d1408f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:44.711856 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b316b311-2651-4f1d-8016-ae7944d1408f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:44.718559 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b316b311-2651-4f1d-8016-ae7944d1408f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:44.719013 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b316b311-2651-4f1d-8016-ae7944d1408f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:44.719795 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b316b311-2651-4f1d-8016-ae7944d1408f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:44.720276 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b316b311-2651-4f1d-8016-ae7944d1408f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:44.804855 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b316b311-2651-4f1d-8016-ae7944d1408f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:44.828685 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b316b311-2651-4f1d-8016-ae7944d1408f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:44.834960 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b316b311-2651-4f1d-8016-ae7944d1408f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:44.836851 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b316b311-2651-4f1d-8016-ae7944d1408f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1334 microversion: 2.20 time: 0.129761 Jun 27 15:49:44.845985 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 122/235] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:49:44 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1334 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:49:44.887981 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b499f70b-2b8e-4afa-b58d-e4279eeb110b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:44.897990 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-b499f70b-2b8e-4afa-b58d-e4279eeb110b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.239046 Jun 27 15:49:44.909259 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 114/236] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:44 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:45.293598 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-35dd2e94-9276-4ad5-81ca-e851955eaf12 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:45.294440 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-35dd2e94-9276-4ad5-81ca-e851955eaf12 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:45.302006 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-35dd2e94-9276-4ad5-81ca-e851955eaf12 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:45.302395 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-35dd2e94-9276-4ad5-81ca-e851955eaf12 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:45.303290 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-35dd2e94-9276-4ad5-81ca-e851955eaf12 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:45.303758 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-35dd2e94-9276-4ad5-81ca-e851955eaf12 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:45.458771 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-35dd2e94-9276-4ad5-81ca-e851955eaf12 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:45.467380 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-35dd2e94-9276-4ad5-81ca-e851955eaf12 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1318 microversion: 2.1 time: 0.178023 Jun 27 15:49:45.468184 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 123/237] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:45 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:45.860001 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f887bbe4-8fde-4159-b0f7-bb63df56ce42 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:45.860606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f887bbe4-8fde-4159-b0f7-bb63df56ce42 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:45.868538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f887bbe4-8fde-4159-b0f7-bb63df56ce42 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:45.868983 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f887bbe4-8fde-4159-b0f7-bb63df56ce42 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:45.869785 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f887bbe4-8fde-4159-b0f7-bb63df56ce42 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:45.870219 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f887bbe4-8fde-4159-b0f7-bb63df56ce42 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:45.916975 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-183fbd5a-6eaa-4eac-8e65-df078472f67a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:45.917498 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-183fbd5a-6eaa-4eac-8e65-df078472f67a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:45.924850 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-183fbd5a-6eaa-4eac-8e65-df078472f67a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:45.925460 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-183fbd5a-6eaa-4eac-8e65-df078472f67a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:45.926635 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-183fbd5a-6eaa-4eac-8e65-df078472f67a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:45.927229 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-183fbd5a-6eaa-4eac-8e65-df078472f67a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:45.936154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f887bbe4-8fde-4159-b0f7-bb63df56ce42 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:45.944349 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f887bbe4-8fde-4159-b0f7-bb63df56ce42 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:45.946599 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f887bbe4-8fde-4159-b0f7-bb63df56ce42 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:45.948307 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f887bbe4-8fde-4159-b0f7-bb63df56ce42 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1352 microversion: 2.20 time: 0.091706 Jun 27 15:49:45.948307 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 115/238] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:49:45 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:49:46.063255 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-183fbd5a-6eaa-4eac-8e65-df078472f67a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:46.072304 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-183fbd5a-6eaa-4eac-8e65-df078472f67a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.160165 Jun 27 15:49:46.072991 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 124/239] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:45 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:46.487440 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-214b4b86-2f51-42d9-9131-b8b557115626 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:46.488048 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-214b4b86-2f51-42d9-9131-b8b557115626 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:46.495097 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-214b4b86-2f51-42d9-9131-b8b557115626 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:46.495583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-214b4b86-2f51-42d9-9131-b8b557115626 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:46.496520 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-214b4b86-2f51-42d9-9131-b8b557115626 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:46.496987 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-214b4b86-2f51-42d9-9131-b8b557115626 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:46.640151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-214b4b86-2f51-42d9-9131-b8b557115626 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:46.648724 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-214b4b86-2f51-42d9-9131-b8b557115626 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1318 microversion: 2.1 time: 0.165345 Jun 27 15:49:46.649353 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 116/240] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:46 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:46.967239 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-6fbeb56e-df93-4aad-83e0-e6387dd2c6b1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:46.967882 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-6fbeb56e-df93-4aad-83e0-e6387dd2c6b1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:46.975261 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6fbeb56e-df93-4aad-83e0-e6387dd2c6b1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:46.975703 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6fbeb56e-df93-4aad-83e0-e6387dd2c6b1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:46.976479 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6fbeb56e-df93-4aad-83e0-e6387dd2c6b1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:46.976917 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6fbeb56e-df93-4aad-83e0-e6387dd2c6b1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:47.047677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-6fbeb56e-df93-4aad-83e0-e6387dd2c6b1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:47.057531 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-6fbeb56e-df93-4aad-83e0-e6387dd2c6b1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:47.059072 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-6fbeb56e-df93-4aad-83e0-e6387dd2c6b1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:47.060304 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-6fbeb56e-df93-4aad-83e0-e6387dd2c6b1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1352 microversion: 2.20 time: 0.096911 Jun 27 15:49:47.060835 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 125/241] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:49:46 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:49:47.089838 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3d8155a6-6bb2-4b7b-bca9-2e4e70e3e7ec tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:47.090658 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3d8155a6-6bb2-4b7b-bca9-2e4e70e3e7ec tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:47.096910 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3d8155a6-6bb2-4b7b-bca9-2e4e70e3e7ec tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:47.097370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3d8155a6-6bb2-4b7b-bca9-2e4e70e3e7ec tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:47.098163 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3d8155a6-6bb2-4b7b-bca9-2e4e70e3e7ec tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:47.098592 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3d8155a6-6bb2-4b7b-bca9-2e4e70e3e7ec tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:47.236256 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3d8155a6-6bb2-4b7b-bca9-2e4e70e3e7ec tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:47.244458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3d8155a6-6bb2-4b7b-bca9-2e4e70e3e7ec tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.158481 Jun 27 15:49:47.245045 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 117/242] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:47 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:47.667769 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f3cda36c-2cc2-4e47-a3a3-d7b1d37e0381 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:47.668231 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f3cda36c-2cc2-4e47-a3a3-d7b1d37e0381 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:47.675129 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f3cda36c-2cc2-4e47-a3a3-d7b1d37e0381 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:47.675566 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f3cda36c-2cc2-4e47-a3a3-d7b1d37e0381 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:47.676319 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f3cda36c-2cc2-4e47-a3a3-d7b1d37e0381 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:47.676742 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f3cda36c-2cc2-4e47-a3a3-d7b1d37e0381 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:47.885097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f3cda36c-2cc2-4e47-a3a3-d7b1d37e0381 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:47.903971 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f3cda36c-2cc2-4e47-a3a3-d7b1d37e0381 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1318 microversion: 2.1 time: 0.239998 Jun 27 15:49:47.916925 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 126/243] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:47 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:49:48.080040 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f9149448-be41-4ed3-8049-f8ea95ea84cb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:48.080688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f9149448-be41-4ed3-8049-f8ea95ea84cb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:48.088353 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f9149448-be41-4ed3-8049-f8ea95ea84cb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:48.088793 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f9149448-be41-4ed3-8049-f8ea95ea84cb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:48.089555 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f9149448-be41-4ed3-8049-f8ea95ea84cb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:48.090035 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f9149448-be41-4ed3-8049-f8ea95ea84cb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:48.189112 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f9149448-be41-4ed3-8049-f8ea95ea84cb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:48.198120 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f9149448-be41-4ed3-8049-f8ea95ea84cb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:48.199608 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f9149448-be41-4ed3-8049-f8ea95ea84cb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:48.200750 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f9149448-be41-4ed3-8049-f8ea95ea84cb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1340 microversion: 2.20 time: 0.124745 Jun 27 15:49:48.201317 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 118/244] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:49:48 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1340 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:49:48.263761 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-cc7ea33a-d0f9-48eb-a962-b09535241f9c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:48.264607 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-cc7ea33a-d0f9-48eb-a962-b09535241f9c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:48.271766 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cc7ea33a-d0f9-48eb-a962-b09535241f9c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:48.272212 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cc7ea33a-d0f9-48eb-a962-b09535241f9c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:48.272980 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cc7ea33a-d0f9-48eb-a962-b09535241f9c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:48.273410 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cc7ea33a-d0f9-48eb-a962-b09535241f9c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:48.468031 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-cc7ea33a-d0f9-48eb-a962-b09535241f9c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:48.480285 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-cc7ea33a-d0f9-48eb-a962-b09535241f9c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.220347 Jun 27 15:49:48.481297 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 127/245] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:48 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:48.926891 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-0f3504e8-9f79-44bf-bc10-bd6825a857dd tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:48.927559 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-0f3504e8-9f79-44bf-bc10-bd6825a857dd tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:48.945607 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0f3504e8-9f79-44bf-bc10-bd6825a857dd tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:48.946375 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0f3504e8-9f79-44bf-bc10-bd6825a857dd tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:48.947341 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0f3504e8-9f79-44bf-bc10-bd6825a857dd tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:48.947915 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0f3504e8-9f79-44bf-bc10-bd6825a857dd tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:49.099848 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0f3504e8-9f79-44bf-bc10-bd6825a857dd tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:49.107942 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-0f3504e8-9f79-44bf-bc10-bd6825a857dd tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1318 microversion: 2.1 time: 0.187197 Jun 27 15:49:49.108515 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 119/246] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:48 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:49.220317 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-aeff15b9-c72f-4749-9139-6b7dae3e311b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:49.220999 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-aeff15b9-c72f-4749-9139-6b7dae3e311b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:49.228101 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-aeff15b9-c72f-4749-9139-6b7dae3e311b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:49.228554 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-aeff15b9-c72f-4749-9139-6b7dae3e311b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:49.229322 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-aeff15b9-c72f-4749-9139-6b7dae3e311b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:49.229779 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-aeff15b9-c72f-4749-9139-6b7dae3e311b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:49.379428 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-aeff15b9-c72f-4749-9139-6b7dae3e311b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:49.383998 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:49:49.394267 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-aeff15b9-c72f-4749-9139-6b7dae3e311b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:49.396497 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-aeff15b9-c72f-4749-9139-6b7dae3e311b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:49.397533 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-aeff15b9-c72f-4749-9139-6b7dae3e311b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1407 microversion: 2.20 time: 0.181271 Jun 27 15:49:49.398051 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 128/247] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:49:49 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:49:49.499829 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-24bd053c-66bf-4d29-9726-5086f631e6af tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:49.500434 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-24bd053c-66bf-4d29-9726-5086f631e6af tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:49.507571 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-24bd053c-66bf-4d29-9726-5086f631e6af tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:49.508024 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-24bd053c-66bf-4d29-9726-5086f631e6af tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:49.508796 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-24bd053c-66bf-4d29-9726-5086f631e6af tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:49.509235 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-24bd053c-66bf-4d29-9726-5086f631e6af tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:49.653141 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-24bd053c-66bf-4d29-9726-5086f631e6af tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:49.661414 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-24bd053c-66bf-4d29-9726-5086f631e6af tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.165431 Jun 27 15:49:49.662027 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 120/248] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:49 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:50.128086 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e44db419-2b00-4da1-b4f6-330907430610 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:50.129795 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e44db419-2b00-4da1-b4f6-330907430610 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:50.140261 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e44db419-2b00-4da1-b4f6-330907430610 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:50.140744 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e44db419-2b00-4da1-b4f6-330907430610 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:50.141621 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e44db419-2b00-4da1-b4f6-330907430610 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:50.142275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e44db419-2b00-4da1-b4f6-330907430610 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:50.282260 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e44db419-2b00-4da1-b4f6-330907430610 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:50.290649 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e44db419-2b00-4da1-b4f6-330907430610 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1318 microversion: 2.1 time: 0.166977 Jun 27 15:49:50.291223 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 129/249] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:50 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:50.415956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a0bc7e9e-bf8c-4abc-b9d4-6b16fc974f91 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:50.416615 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a0bc7e9e-bf8c-4abc-b9d4-6b16fc974f91 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:50.424246 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a0bc7e9e-bf8c-4abc-b9d4-6b16fc974f91 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:50.424430 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a0bc7e9e-bf8c-4abc-b9d4-6b16fc974f91 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:50.425104 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a0bc7e9e-bf8c-4abc-b9d4-6b16fc974f91 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:50.425555 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a0bc7e9e-bf8c-4abc-b9d4-6b16fc974f91 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:50.569440 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a0bc7e9e-bf8c-4abc-b9d4-6b16fc974f91 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:50.577843 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a0bc7e9e-bf8c-4abc-b9d4-6b16fc974f91 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:50.579345 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a0bc7e9e-bf8c-4abc-b9d4-6b16fc974f91 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:50.580465 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-a0bc7e9e-bf8c-4abc-b9d4-6b16fc974f91 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1407 microversion: 2.20 time: 0.168379 Jun 27 15:49:50.581032 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 121/250] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:49:50 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:49:50.681417 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d87e83f5-a80c-4f80-9306-f40eecef1050 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:50.682235 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d87e83f5-a80c-4f80-9306-f40eecef1050 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:50.688507 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d87e83f5-a80c-4f80-9306-f40eecef1050 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:50.688962 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d87e83f5-a80c-4f80-9306-f40eecef1050 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:50.689786 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d87e83f5-a80c-4f80-9306-f40eecef1050 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:50.690229 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d87e83f5-a80c-4f80-9306-f40eecef1050 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:50.856514 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d87e83f5-a80c-4f80-9306-f40eecef1050 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:50.865207 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d87e83f5-a80c-4f80-9306-f40eecef1050 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.187467 Jun 27 15:49:50.865979 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 130/251] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:50 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:51.308913 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-4921feec-2725-4a23-a1b2-a5a8a7c57956 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:51.309844 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-4921feec-2725-4a23-a1b2-a5a8a7c57956 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:51.317939 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4921feec-2725-4a23-a1b2-a5a8a7c57956 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:51.318627 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4921feec-2725-4a23-a1b2-a5a8a7c57956 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:51.319615 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4921feec-2725-4a23-a1b2-a5a8a7c57956 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:51.320324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4921feec-2725-4a23-a1b2-a5a8a7c57956 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:51.463399 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-4921feec-2725-4a23-a1b2-a5a8a7c57956 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:51.472258 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-4921feec-2725-4a23-a1b2-a5a8a7c57956 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1318 microversion: 2.1 time: 0.167647 Jun 27 15:49:51.473052 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 122/252] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:51 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:51.600667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-eb7f74d6-05ae-4daf-9b5c-e8e2b70a8c58 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:51.601378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-eb7f74d6-05ae-4daf-9b5c-e8e2b70a8c58 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:51.608256 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eb7f74d6-05ae-4daf-9b5c-e8e2b70a8c58 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:51.608701 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eb7f74d6-05ae-4daf-9b5c-e8e2b70a8c58 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:51.609497 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eb7f74d6-05ae-4daf-9b5c-e8e2b70a8c58 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:51.610069 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eb7f74d6-05ae-4daf-9b5c-e8e2b70a8c58 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:51.847629 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-eb7f74d6-05ae-4daf-9b5c-e8e2b70a8c58 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:51.856338 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-eb7f74d6-05ae-4daf-9b5c-e8e2b70a8c58 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:51.858173 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-eb7f74d6-05ae-4daf-9b5c-e8e2b70a8c58 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:51.859433 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-eb7f74d6-05ae-4daf-9b5c-e8e2b70a8c58 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1407 microversion: 2.20 time: 0.263776 Jun 27 15:49:51.859987 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 131/253] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:49:51 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:49:51.884324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-7dba9195-6d11-4268-a3ed-7f13dfa7ead9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:51.885152 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-7dba9195-6d11-4268-a3ed-7f13dfa7ead9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:51.891823 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7dba9195-6d11-4268-a3ed-7f13dfa7ead9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:51.892289 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7dba9195-6d11-4268-a3ed-7f13dfa7ead9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:51.893159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7dba9195-6d11-4268-a3ed-7f13dfa7ead9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:51.893768 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7dba9195-6d11-4268-a3ed-7f13dfa7ead9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:52.132243 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-7dba9195-6d11-4268-a3ed-7f13dfa7ead9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:52.142781 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-7dba9195-6d11-4268-a3ed-7f13dfa7ead9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.263935 Jun 27 15:49:52.144209 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 123/254] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:51 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:52.388506 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-cbd219c7-8bb9-47ca-956e-e0b1dfea6da5 req-e667d614-1087-44b3-aef6-2331c25aad96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9cda787-8842-478e-9fae-1c95d057875f", "tag": "cc266a26-7ff1-44ed-a332-b97209b03a63"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:49:52.400793 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-cbd219c7-8bb9-47ca-956e-e0b1dfea6da5 req-e667d614-1087-44b3-aef6-2331c25aad96 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:52.401870 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-cbd219c7-8bb9-47ca-956e-e0b1dfea6da5 req-e667d614-1087-44b3-aef6-2331c25aad96 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:52.416149 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-cbd219c7-8bb9-47ca-956e-e0b1dfea6da5 req-e667d614-1087-44b3-aef6-2331c25aad96 service nova] Creating event network-changed:cc266a26-7ff1-44ed-a332-b97209b03a63 for instance b9cda787-8842-478e-9fae-1c95d057875f on hv-cinder-84780 Jun 27 15:49:52.422803 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-cbd219c7-8bb9-47ca-956e-e0b1dfea6da5 req-e667d614-1087-44b3-aef6-2331c25aad96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037781 Jun 27 15:49:52.423807 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 132/255] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:49:52.488412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9a4d9956-280a-4a3f-bba5-4437b6f50035 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:52.489912 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9a4d9956-280a-4a3f-bba5-4437b6f50035 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:52.499050 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9a4d9956-280a-4a3f-bba5-4437b6f50035 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:52.499507 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9a4d9956-280a-4a3f-bba5-4437b6f50035 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:52.500302 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9a4d9956-280a-4a3f-bba5-4437b6f50035 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:52.500797 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9a4d9956-280a-4a3f-bba5-4437b6f50035 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:52.658687 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9a4d9956-280a-4a3f-bba5-4437b6f50035 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:52.680105 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9a4d9956-280a-4a3f-bba5-4437b6f50035 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1318 microversion: 2.1 time: 0.195463 Jun 27 15:49:52.680820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 124/256] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:52 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:52.878299 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a19b5e31-f4c2-43af-b55e-5a9234507538 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:52.879513 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a19b5e31-f4c2-43af-b55e-5a9234507538 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:52.886787 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a19b5e31-f4c2-43af-b55e-5a9234507538 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:52.887356 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a19b5e31-f4c2-43af-b55e-5a9234507538 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:52.888625 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a19b5e31-f4c2-43af-b55e-5a9234507538 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:52.889214 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a19b5e31-f4c2-43af-b55e-5a9234507538 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:53.039861 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a19b5e31-f4c2-43af-b55e-5a9234507538 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:53.046943 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a19b5e31-f4c2-43af-b55e-5a9234507538 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:53.048424 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a19b5e31-f4c2-43af-b55e-5a9234507538 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:53.049613 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a19b5e31-f4c2-43af-b55e-5a9234507538 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1407 microversion: 2.20 time: 0.175698 Jun 27 15:49:53.051394 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 133/257] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:49:52 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:49:53.163622 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ba0dbe66-1b6d-4e41-8f95-a0347e800980 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:53.164740 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-ba0dbe66-1b6d-4e41-8f95-a0347e800980 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:53.175633 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ba0dbe66-1b6d-4e41-8f95-a0347e800980 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:53.177060 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ba0dbe66-1b6d-4e41-8f95-a0347e800980 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:53.178537 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ba0dbe66-1b6d-4e41-8f95-a0347e800980 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:53.178992 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ba0dbe66-1b6d-4e41-8f95-a0347e800980 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:53.338306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ba0dbe66-1b6d-4e41-8f95-a0347e800980 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:53.346606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ba0dbe66-1b6d-4e41-8f95-a0347e800980 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.189278 Jun 27 15:49:53.347176 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 125/258] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:53 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:53.697568 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f06f7167-b2d6-4660-9cf2-a5bccd9ca1a1 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:53.698205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f06f7167-b2d6-4660-9cf2-a5bccd9ca1a1 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:53.700152 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=2 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:49:53.700843 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=12 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:49:53.701502 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:49:53.706891 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f06f7167-b2d6-4660-9cf2-a5bccd9ca1a1 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:53.707989 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f06f7167-b2d6-4660-9cf2-a5bccd9ca1a1 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:53.708875 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f06f7167-b2d6-4660-9cf2-a5bccd9ca1a1 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:53.709318 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f06f7167-b2d6-4660-9cf2-a5bccd9ca1a1 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:53.870053 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f06f7167-b2d6-4660-9cf2-a5bccd9ca1a1 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:53.881026 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f06f7167-b2d6-4660-9cf2-a5bccd9ca1a1 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1318 microversion: 2.1 time: 0.187184 Jun 27 15:49:53.881748 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 134/259] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:53 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:49:54.070068 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-1804032d-49e5-43d0-bb4e-52b0b0594ead tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:54.070840 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-1804032d-49e5-43d0-bb4e-52b0b0594ead tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:54.073533 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=2 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:49:54.080661 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1804032d-49e5-43d0-bb4e-52b0b0594ead tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:54.081273 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1804032d-49e5-43d0-bb4e-52b0b0594ead tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:54.082848 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1804032d-49e5-43d0-bb4e-52b0b0594ead tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:54.083301 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1804032d-49e5-43d0-bb4e-52b0b0594ead tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:54.233970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-1804032d-49e5-43d0-bb4e-52b0b0594ead tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:54.237352 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=100 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:49:54.244274 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-1804032d-49e5-43d0-bb4e-52b0b0594ead tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:54.245839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-1804032d-49e5-43d0-bb4e-52b0b0594ead tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:54.246946 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-1804032d-49e5-43d0-bb4e-52b0b0594ead tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1407 microversion: 2.20 time: 0.181669 Jun 27 15:49:54.247499 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 126/260] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:49:54 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:49:54.365721 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-44b3a0ba-e73e-4f78-9491-1e2de3687a43 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:54.366862 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-44b3a0ba-e73e-4f78-9491-1e2de3687a43 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:54.372968 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-44b3a0ba-e73e-4f78-9491-1e2de3687a43 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:54.373498 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-44b3a0ba-e73e-4f78-9491-1e2de3687a43 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:54.374413 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-44b3a0ba-e73e-4f78-9491-1e2de3687a43 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:54.374880 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-44b3a0ba-e73e-4f78-9491-1e2de3687a43 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:54.524556 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-44b3a0ba-e73e-4f78-9491-1e2de3687a43 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:54.534126 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-44b3a0ba-e73e-4f78-9491-1e2de3687a43 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.173032 Jun 27 15:49:54.534724 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 135/261] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:54 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:54.903122 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9d6b1646-6073-44e6-a0fb-179eb69a02af tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:54.903977 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9d6b1646-6073-44e6-a0fb-179eb69a02af tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:54.913364 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9d6b1646-6073-44e6-a0fb-179eb69a02af tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:54.913868 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9d6b1646-6073-44e6-a0fb-179eb69a02af tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:54.914715 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9d6b1646-6073-44e6-a0fb-179eb69a02af tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:54.915156 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9d6b1646-6073-44e6-a0fb-179eb69a02af tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:55.062074 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9d6b1646-6073-44e6-a0fb-179eb69a02af tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:55.071184 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9d6b1646-6073-44e6-a0fb-179eb69a02af tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1507 microversion: 2.1 time: 0.172781 Jun 27 15:49:55.071896 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 127/262] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:54 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:55.271178 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b00422ed-3b05-4535-a81b-8697ce3ae22d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:55.272016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b00422ed-3b05-4535-a81b-8697ce3ae22d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:55.279581 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b00422ed-3b05-4535-a81b-8697ce3ae22d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:55.280077 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b00422ed-3b05-4535-a81b-8697ce3ae22d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:55.281277 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b00422ed-3b05-4535-a81b-8697ce3ae22d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:55.282349 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b00422ed-3b05-4535-a81b-8697ce3ae22d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:55.455137 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b00422ed-3b05-4535-a81b-8697ce3ae22d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:55.465729 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b00422ed-3b05-4535-a81b-8697ce3ae22d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:55.469994 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b00422ed-3b05-4535-a81b-8697ce3ae22d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:55.471423 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b00422ed-3b05-4535-a81b-8697ce3ae22d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1407 microversion: 2.20 time: 0.207647 Jun 27 15:49:55.473196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 136/263] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:49:55 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:49:55.562165 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-58d35331-ab14-4b25-aa69-fe36123bfd57 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:55.562165 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-58d35331-ab14-4b25-aa69-fe36123bfd57 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:55.585837 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-58d35331-ab14-4b25-aa69-fe36123bfd57 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:55.586295 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-58d35331-ab14-4b25-aa69-fe36123bfd57 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:55.587080 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-58d35331-ab14-4b25-aa69-fe36123bfd57 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:55.590477 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-58d35331-ab14-4b25-aa69-fe36123bfd57 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:55.785206 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-58d35331-ab14-4b25-aa69-fe36123bfd57 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:55.793868 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-58d35331-ab14-4b25-aa69-fe36123bfd57 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.245360 Jun 27 15:49:55.794404 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 128/264] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:55 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:56.491588 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-52d78600-57da-4cca-b9f4-c392fd9d9441 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:56.492194 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-52d78600-57da-4cca-b9f4-c392fd9d9441 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:56.498332 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-52d78600-57da-4cca-b9f4-c392fd9d9441 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:56.498787 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-52d78600-57da-4cca-b9f4-c392fd9d9441 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:56.499558 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-52d78600-57da-4cca-b9f4-c392fd9d9441 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:56.499995 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-52d78600-57da-4cca-b9f4-c392fd9d9441 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:56.638784 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-52d78600-57da-4cca-b9f4-c392fd9d9441 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:56.647448 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-52d78600-57da-4cca-b9f4-c392fd9d9441 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:56.648924 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-52d78600-57da-4cca-b9f4-c392fd9d9441 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:56.650049 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-52d78600-57da-4cca-b9f4-c392fd9d9441 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1407 microversion: 2.20 time: 0.162390 Jun 27 15:49:56.650601 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 137/265] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:49:56 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:49:56.811860 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3ae04a53-9265-4ab2-889a-8fd0a1996e23 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:56.812415 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3ae04a53-9265-4ab2-889a-8fd0a1996e23 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:56.819821 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3ae04a53-9265-4ab2-889a-8fd0a1996e23 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:56.820289 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3ae04a53-9265-4ab2-889a-8fd0a1996e23 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:56.821054 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3ae04a53-9265-4ab2-889a-8fd0a1996e23 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:56.821495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3ae04a53-9265-4ab2-889a-8fd0a1996e23 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:57.098716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3ae04a53-9265-4ab2-889a-8fd0a1996e23 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:57.106837 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3ae04a53-9265-4ab2-889a-8fd0a1996e23 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.298816 Jun 27 15:49:57.107476 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 129/266] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:56 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:57.668658 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-2d4a0308-f291-42d3-9f9e-53db21a40a3d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:57.669306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-2d4a0308-f291-42d3-9f9e-53db21a40a3d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:57.676862 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2d4a0308-f291-42d3-9f9e-53db21a40a3d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:57.677331 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2d4a0308-f291-42d3-9f9e-53db21a40a3d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:57.678141 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2d4a0308-f291-42d3-9f9e-53db21a40a3d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:57.678581 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2d4a0308-f291-42d3-9f9e-53db21a40a3d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:57.840627 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2d4a0308-f291-42d3-9f9e-53db21a40a3d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:57.849430 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2d4a0308-f291-42d3-9f9e-53db21a40a3d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:57.850990 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2d4a0308-f291-42d3-9f9e-53db21a40a3d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:57.852106 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-2d4a0308-f291-42d3-9f9e-53db21a40a3d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1407 microversion: 2.20 time: 0.187474 Jun 27 15:49:57.852666 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 138/267] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:49:57 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:49:58.125979 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f84870a5-0a05-4f0a-99d8-f43b39971055 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:58.126625 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f84870a5-0a05-4f0a-99d8-f43b39971055 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:58.133882 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f84870a5-0a05-4f0a-99d8-f43b39971055 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:58.134336 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f84870a5-0a05-4f0a-99d8-f43b39971055 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:58.135110 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f84870a5-0a05-4f0a-99d8-f43b39971055 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:58.135545 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f84870a5-0a05-4f0a-99d8-f43b39971055 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:58.604339 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f84870a5-0a05-4f0a-99d8-f43b39971055 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:58.613877 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f84870a5-0a05-4f0a-99d8-f43b39971055 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.491654 Jun 27 15:49:58.614474 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 130/268] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:58 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:49:58.870185 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c6028f09-e63b-489f-8dd2-2296c3e5c4b3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:58.870827 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c6028f09-e63b-489f-8dd2-2296c3e5c4b3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:58.876989 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c6028f09-e63b-489f-8dd2-2296c3e5c4b3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:58.877440 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c6028f09-e63b-489f-8dd2-2296c3e5c4b3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:58.878256 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c6028f09-e63b-489f-8dd2-2296c3e5c4b3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:58.878804 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c6028f09-e63b-489f-8dd2-2296c3e5c4b3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:59.103853 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-c6028f09-e63b-489f-8dd2-2296c3e5c4b3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:59.112084 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-c6028f09-e63b-489f-8dd2-2296c3e5c4b3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:59.115006 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-c6028f09-e63b-489f-8dd2-2296c3e5c4b3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:59.116074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c6028f09-e63b-489f-8dd2-2296c3e5c4b3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1407 microversion: 2.20 time: 0.249776 Jun 27 15:49:59.116638 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 139/269] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:49:58 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:49:59.632403 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ed600f95-3f6a-4480-9a0f-a94de8aa7a5b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:49:59.633130 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-ed600f95-3f6a-4480-9a0f-a94de8aa7a5b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:49:59.635699 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:49:59.642176 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ed600f95-3f6a-4480-9a0f-a94de8aa7a5b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:59.642618 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ed600f95-3f6a-4480-9a0f-a94de8aa7a5b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:59.643402 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ed600f95-3f6a-4480-9a0f-a94de8aa7a5b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:49:59.644840 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ed600f95-3f6a-4480-9a0f-a94de8aa7a5b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:49:59.805894 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ed600f95-3f6a-4480-9a0f-a94de8aa7a5b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:49:59.814130 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ed600f95-3f6a-4480-9a0f-a94de8aa7a5b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.186625 Jun 27 15:49:59.814799 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 131/270] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:49:59 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:00.135318 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0d2d641e-a335-4e13-a48d-f47dc5eca84c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:00.136035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-0d2d641e-a335-4e13-a48d-f47dc5eca84c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:00.142173 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0d2d641e-a335-4e13-a48d-f47dc5eca84c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:00.142611 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0d2d641e-a335-4e13-a48d-f47dc5eca84c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:00.143371 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0d2d641e-a335-4e13-a48d-f47dc5eca84c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:00.143795 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0d2d641e-a335-4e13-a48d-f47dc5eca84c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:00.281526 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-0d2d641e-a335-4e13-a48d-f47dc5eca84c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:00.290527 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-0d2d641e-a335-4e13-a48d-f47dc5eca84c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:00.292067 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-0d2d641e-a335-4e13-a48d-f47dc5eca84c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:00.293198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-0d2d641e-a335-4e13-a48d-f47dc5eca84c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1407 microversion: 2.20 time: 0.161826 Jun 27 15:50:00.293764 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 140/271] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:50:00 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:50:00.833039 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-171b743b-67b6-4ce4-bc42-f3e047dd89c2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:00.833789 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-171b743b-67b6-4ce4-bc42-f3e047dd89c2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:00.840649 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-171b743b-67b6-4ce4-bc42-f3e047dd89c2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:00.841149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-171b743b-67b6-4ce4-bc42-f3e047dd89c2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:00.842068 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-171b743b-67b6-4ce4-bc42-f3e047dd89c2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:00.842595 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-171b743b-67b6-4ce4-bc42-f3e047dd89c2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:00.980872 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-171b743b-67b6-4ce4-bc42-f3e047dd89c2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:00.989319 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-171b743b-67b6-4ce4-bc42-f3e047dd89c2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.160701 Jun 27 15:50:00.989923 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 132/272] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:00 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:01.312423 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e9aecf3c-e743-46e9-b8c8-4e17463cb26b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:01.313025 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e9aecf3c-e743-46e9-b8c8-4e17463cb26b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:01.319998 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e9aecf3c-e743-46e9-b8c8-4e17463cb26b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:01.320447 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e9aecf3c-e743-46e9-b8c8-4e17463cb26b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:01.321210 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e9aecf3c-e743-46e9-b8c8-4e17463cb26b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:01.321656 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e9aecf3c-e743-46e9-b8c8-4e17463cb26b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:01.449150 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e9aecf3c-e743-46e9-b8c8-4e17463cb26b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:01.457095 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e9aecf3c-e743-46e9-b8c8-4e17463cb26b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:01.458630 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e9aecf3c-e743-46e9-b8c8-4e17463cb26b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:01.459739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e9aecf3c-e743-46e9-b8c8-4e17463cb26b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1407 microversion: 2.20 time: 0.151334 Jun 27 15:50:01.460298 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 141/273] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:50:01 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:50:02.007552 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-0ecf1c9a-a052-4c94-877f-0953fbf31337 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:02.008159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-0ecf1c9a-a052-4c94-877f-0953fbf31337 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:02.014101 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0ecf1c9a-a052-4c94-877f-0953fbf31337 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:02.014541 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0ecf1c9a-a052-4c94-877f-0953fbf31337 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:02.015290 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0ecf1c9a-a052-4c94-877f-0953fbf31337 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:02.015717 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0ecf1c9a-a052-4c94-877f-0953fbf31337 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:02.148218 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0ecf1c9a-a052-4c94-877f-0953fbf31337 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:02.155747 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-0ecf1c9a-a052-4c94-877f-0953fbf31337 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.152631 Jun 27 15:50:02.156309 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 133/274] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:02 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:02.479454 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-1581aa94-886b-4316-b4ba-0e1d88e540f7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:02.480075 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-1581aa94-886b-4316-b4ba-0e1d88e540f7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:02.486233 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1581aa94-886b-4316-b4ba-0e1d88e540f7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:02.486682 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1581aa94-886b-4316-b4ba-0e1d88e540f7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:02.487444 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1581aa94-886b-4316-b4ba-0e1d88e540f7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:02.487903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1581aa94-886b-4316-b4ba-0e1d88e540f7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:02.624149 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-1581aa94-886b-4316-b4ba-0e1d88e540f7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:02.632667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-1581aa94-886b-4316-b4ba-0e1d88e540f7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:02.634111 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-1581aa94-886b-4316-b4ba-0e1d88e540f7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:02.635216 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-1581aa94-886b-4316-b4ba-0e1d88e540f7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1407 microversion: 2.20 time: 0.159883 Jun 27 15:50:02.635767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 142/275] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:50:02 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:50:03.173988 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-96466158-e0fe-4903-9bbc-80437bc60c07 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:03.174606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-96466158-e0fe-4903-9bbc-80437bc60c07 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:03.184201 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-96466158-e0fe-4903-9bbc-80437bc60c07 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:03.184934 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-96466158-e0fe-4903-9bbc-80437bc60c07 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:03.186105 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-96466158-e0fe-4903-9bbc-80437bc60c07 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:03.186603 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-96466158-e0fe-4903-9bbc-80437bc60c07 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:03.386584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-96466158-e0fe-4903-9bbc-80437bc60c07 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:03.396060 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-96466158-e0fe-4903-9bbc-80437bc60c07 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.226055 Jun 27 15:50:03.396640 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 134/276] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:03 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:03.652592 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-187a0207-12ad-4ef6-9352-8d6541300d8d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:03.657549 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-187a0207-12ad-4ef6-9352-8d6541300d8d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:03.665017 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-187a0207-12ad-4ef6-9352-8d6541300d8d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:03.665514 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-187a0207-12ad-4ef6-9352-8d6541300d8d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:03.666313 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-187a0207-12ad-4ef6-9352-8d6541300d8d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:03.666751 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-187a0207-12ad-4ef6-9352-8d6541300d8d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:03.889318 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-187a0207-12ad-4ef6-9352-8d6541300d8d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:03.898959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-187a0207-12ad-4ef6-9352-8d6541300d8d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:03.900567 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-187a0207-12ad-4ef6-9352-8d6541300d8d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:03.901833 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-187a0207-12ad-4ef6-9352-8d6541300d8d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1407 microversion: 2.20 time: 0.253199 Jun 27 15:50:03.902453 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 143/277] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:50:03 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:50:04.413442 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c2ce5536-f343-4d67-b47e-20f47679ed6d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:04.414435 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c2ce5536-f343-4d67-b47e-20f47679ed6d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:04.421476 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c2ce5536-f343-4d67-b47e-20f47679ed6d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:04.422042 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c2ce5536-f343-4d67-b47e-20f47679ed6d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:04.422869 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c2ce5536-f343-4d67-b47e-20f47679ed6d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:04.423375 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c2ce5536-f343-4d67-b47e-20f47679ed6d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:04.579321 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-c2ce5536-f343-4d67-b47e-20f47679ed6d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:04.591754 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c2ce5536-f343-4d67-b47e-20f47679ed6d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.182241 Jun 27 15:50:04.593249 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 135/278] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:04 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:04.924928 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f5141d13-e2d6-4811-87a2-ff5bc163e058 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:04.926247 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f5141d13-e2d6-4811-87a2-ff5bc163e058 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:04.939631 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f5141d13-e2d6-4811-87a2-ff5bc163e058 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:04.940273 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f5141d13-e2d6-4811-87a2-ff5bc163e058 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:04.941369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f5141d13-e2d6-4811-87a2-ff5bc163e058 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:04.942151 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f5141d13-e2d6-4811-87a2-ff5bc163e058 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:05.238433 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f5141d13-e2d6-4811-87a2-ff5bc163e058 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:05.246549 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f5141d13-e2d6-4811-87a2-ff5bc163e058 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:05.248298 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f5141d13-e2d6-4811-87a2-ff5bc163e058 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:05.249558 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f5141d13-e2d6-4811-87a2-ff5bc163e058 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1407 microversion: 2.20 time: 0.332366 Jun 27 15:50:05.250295 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 144/279] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:50:04 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:50:05.610400 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-7a5e6978-3298-439b-89b6-10688f0608df tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:05.611116 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-7a5e6978-3298-439b-89b6-10688f0608df tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:05.619000 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7a5e6978-3298-439b-89b6-10688f0608df tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:05.619991 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7a5e6978-3298-439b-89b6-10688f0608df tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:05.621053 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7a5e6978-3298-439b-89b6-10688f0608df tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:05.621491 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7a5e6978-3298-439b-89b6-10688f0608df tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:05.761288 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-7a5e6978-3298-439b-89b6-10688f0608df tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:05.769599 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-7a5e6978-3298-439b-89b6-10688f0608df tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.162538 Jun 27 15:50:05.770558 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 136/280] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:05 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:06.268499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-2724acb6-5c50-4eab-a8fa-eb44b39d8955 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:06.269712 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-2724acb6-5c50-4eab-a8fa-eb44b39d8955 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:06.275768 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2724acb6-5c50-4eab-a8fa-eb44b39d8955 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:06.276333 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2724acb6-5c50-4eab-a8fa-eb44b39d8955 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:06.277099 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2724acb6-5c50-4eab-a8fa-eb44b39d8955 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:06.277532 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2724acb6-5c50-4eab-a8fa-eb44b39d8955 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:06.463281 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2724acb6-5c50-4eab-a8fa-eb44b39d8955 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:06.473301 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2724acb6-5c50-4eab-a8fa-eb44b39d8955 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:06.475164 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2724acb6-5c50-4eab-a8fa-eb44b39d8955 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:06.476368 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-2724acb6-5c50-4eab-a8fa-eb44b39d8955 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1407 microversion: 2.20 time: 0.212242 Jun 27 15:50:06.477133 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 145/281] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:50:06 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:50:06.787894 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d9c9ea5d-292d-4fd6-82c4-70ac0920f67e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:06.788491 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d9c9ea5d-292d-4fd6-82c4-70ac0920f67e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:06.796580 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d9c9ea5d-292d-4fd6-82c4-70ac0920f67e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:06.797024 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d9c9ea5d-292d-4fd6-82c4-70ac0920f67e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:06.797959 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d9c9ea5d-292d-4fd6-82c4-70ac0920f67e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:06.798363 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d9c9ea5d-292d-4fd6-82c4-70ac0920f67e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:06.943237 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d9c9ea5d-292d-4fd6-82c4-70ac0920f67e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:06.951538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d9c9ea5d-292d-4fd6-82c4-70ac0920f67e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.167731 Jun 27 15:50:06.952117 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 137/282] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:06 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:07.500692 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-93b17d23-74db-46d8-a325-29caa5f6fa7d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:07.502018 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-93b17d23-74db-46d8-a325-29caa5f6fa7d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:07.509822 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-93b17d23-74db-46d8-a325-29caa5f6fa7d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:07.510534 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-93b17d23-74db-46d8-a325-29caa5f6fa7d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:07.511314 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-93b17d23-74db-46d8-a325-29caa5f6fa7d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:07.511753 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-93b17d23-74db-46d8-a325-29caa5f6fa7d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:07.514493 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=100 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:07.724440 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-93b17d23-74db-46d8-a325-29caa5f6fa7d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:07.733460 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-93b17d23-74db-46d8-a325-29caa5f6fa7d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:07.735083 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-93b17d23-74db-46d8-a325-29caa5f6fa7d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:07.736288 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-93b17d23-74db-46d8-a325-29caa5f6fa7d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1407 microversion: 2.20 time: 0.239822 Jun 27 15:50:07.736840 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 146/283] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:50:07 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:50:07.968339 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c100a272-6104-424e-985e-21d9d72e3f93 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:07.969613 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c100a272-6104-424e-985e-21d9d72e3f93 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:07.977453 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c100a272-6104-424e-985e-21d9d72e3f93 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:07.979658 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c100a272-6104-424e-985e-21d9d72e3f93 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:07.979658 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c100a272-6104-424e-985e-21d9d72e3f93 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:07.979658 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c100a272-6104-424e-985e-21d9d72e3f93 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:08.209104 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-c100a272-6104-424e-985e-21d9d72e3f93 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:08.217528 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c100a272-6104-424e-985e-21d9d72e3f93 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.253001 Jun 27 15:50:08.218467 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 138/284] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:07 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:08.558002 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-5d6bcb68-5d1c-4011-b6e7-d87f55ec0307 req-ae6e68f8-f0f6-4d77-8e90-87154eb2324b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9cda787-8842-478e-9fae-1c95d057875f", "name": "network-vif-plugged", "status": "completed", "tag": "cc266a26-7ff1-44ed-a332-b97209b03a63"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:08.574332 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-5d6bcb68-5d1c-4011-b6e7-d87f55ec0307 req-ae6e68f8-f0f6-4d77-8e90-87154eb2324b service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:08.574781 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-5d6bcb68-5d1c-4011-b6e7-d87f55ec0307 req-ae6e68f8-f0f6-4d77-8e90-87154eb2324b service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:08.593001 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-5d6bcb68-5d1c-4011-b6e7-d87f55ec0307 req-ae6e68f8-f0f6-4d77-8e90-87154eb2324b service nova] Creating event network-vif-plugged:cc266a26-7ff1-44ed-a332-b97209b03a63 for instance b9cda787-8842-478e-9fae-1c95d057875f on hv-cinder-84780 Jun 27 15:50:08.601749 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-5d6bcb68-5d1c-4011-b6e7-d87f55ec0307 req-ae6e68f8-f0f6-4d77-8e90-87154eb2324b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047206 Jun 27 15:50:08.609819 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 147/285] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:50:08.760116 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3d74b38c-a1b9-478e-be19-1f162472f6b5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:08.762639 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3d74b38c-a1b9-478e-be19-1f162472f6b5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:08.773909 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3d74b38c-a1b9-478e-be19-1f162472f6b5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:08.774689 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3d74b38c-a1b9-478e-be19-1f162472f6b5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:08.776258 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3d74b38c-a1b9-478e-be19-1f162472f6b5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:08.776935 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3d74b38c-a1b9-478e-be19-1f162472f6b5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:08.996765 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3d74b38c-a1b9-478e-be19-1f162472f6b5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:09.013691 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3d74b38c-a1b9-478e-be19-1f162472f6b5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:09.015766 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3d74b38c-a1b9-478e-be19-1f162472f6b5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:09.022045 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3d74b38c-a1b9-478e-be19-1f162472f6b5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1407 microversion: 2.20 time: 0.270628 Jun 27 15:50:09.023168 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 139/286] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:50:08 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:50:09.243833 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e25d8a66-34f9-49df-a3bd-b8e76c34d783 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:09.244998 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e25d8a66-34f9-49df-a3bd-b8e76c34d783 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:09.254102 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e25d8a66-34f9-49df-a3bd-b8e76c34d783 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:09.254931 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e25d8a66-34f9-49df-a3bd-b8e76c34d783 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:09.255953 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e25d8a66-34f9-49df-a3bd-b8e76c34d783 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:09.256778 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e25d8a66-34f9-49df-a3bd-b8e76c34d783 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:09.508728 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e25d8a66-34f9-49df-a3bd-b8e76c34d783 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:09.516349 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e25d8a66-34f9-49df-a3bd-b8e76c34d783 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.281328 Jun 27 15:50:09.516916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 148/287] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:09 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:10.042561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-b0928ffa-6d20-4c33-8baf-c693654e1600 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:10.043770 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-b0928ffa-6d20-4c33-8baf-c693654e1600 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:10.059803 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b0928ffa-6d20-4c33-8baf-c693654e1600 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:10.060438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b0928ffa-6d20-4c33-8baf-c693654e1600 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:10.061387 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b0928ffa-6d20-4c33-8baf-c693654e1600 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:10.061847 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b0928ffa-6d20-4c33-8baf-c693654e1600 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:10.276008 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b0928ffa-6d20-4c33-8baf-c693654e1600 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:10.285886 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b0928ffa-6d20-4c33-8baf-c693654e1600 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:10.295690 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b0928ffa-6d20-4c33-8baf-c693654e1600 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:10.300346 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-b0928ffa-6d20-4c33-8baf-c693654e1600 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1407 microversion: 2.20 time: 0.261866 Jun 27 15:50:10.303245 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 140/288] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:50:10 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:50:10.533916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0522ea75-82d2-4295-b08c-45ee2974d9c7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:10.534624 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-0522ea75-82d2-4295-b08c-45ee2974d9c7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:10.545320 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0522ea75-82d2-4295-b08c-45ee2974d9c7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:10.554153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0522ea75-82d2-4295-b08c-45ee2974d9c7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:10.555210 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0522ea75-82d2-4295-b08c-45ee2974d9c7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:10.555926 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0522ea75-82d2-4295-b08c-45ee2974d9c7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:10.804213 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-0522ea75-82d2-4295-b08c-45ee2974d9c7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:10.820240 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-0522ea75-82d2-4295-b08c-45ee2974d9c7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.290420 Jun 27 15:50:10.820812 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 149/289] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:10 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:11.322201 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-173116fa-bbe9-4554-8f1b-bccc7a787d1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:11.322838 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-173116fa-bbe9-4554-8f1b-bccc7a787d1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:11.333001 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-173116fa-bbe9-4554-8f1b-bccc7a787d1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:11.334343 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-173116fa-bbe9-4554-8f1b-bccc7a787d1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:11.335186 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-173116fa-bbe9-4554-8f1b-bccc7a787d1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:11.335616 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-173116fa-bbe9-4554-8f1b-bccc7a787d1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:11.546546 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-173116fa-bbe9-4554-8f1b-bccc7a787d1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:11.555558 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-5a754351-1233-4862-9476-9162f419ad1d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:11.558406 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-5a754351-1233-4862-9476-9162f419ad1d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:11.562470 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-173116fa-bbe9-4554-8f1b-bccc7a787d1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:11.565301 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-173116fa-bbe9-4554-8f1b-bccc7a787d1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:11.567268 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-173116fa-bbe9-4554-8f1b-bccc7a787d1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1407 microversion: 2.20 time: 0.249694 Jun 27 15:50:11.568164 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 141/290] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:50:11 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:50:11.568608 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5a754351-1233-4862-9476-9162f419ad1d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:11.569206 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5a754351-1233-4862-9476-9162f419ad1d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:11.570070 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5a754351-1233-4862-9476-9162f419ad1d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:11.570544 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5a754351-1233-4862-9476-9162f419ad1d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:11.596813 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-5a754351-1233-4862-9476-9162f419ad1d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb/ips" status: 200 len: 146 microversion: 2.1 time: 0.046126 Jun 27 15:50:11.597428 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 150/291] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 27 15:50:11 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb/ips => generated 146 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:50:11.836969 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9105252a-6ee1-422c-a79f-0d11c3ed9b1d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:11.838013 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9105252a-6ee1-422c-a79f-0d11c3ed9b1d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:11.845651 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9105252a-6ee1-422c-a79f-0d11c3ed9b1d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:11.846113 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9105252a-6ee1-422c-a79f-0d11c3ed9b1d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:11.847172 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9105252a-6ee1-422c-a79f-0d11c3ed9b1d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:11.848041 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9105252a-6ee1-422c-a79f-0d11c3ed9b1d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:12.177016 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9105252a-6ee1-422c-a79f-0d11c3ed9b1d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:12.186934 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9105252a-6ee1-422c-a79f-0d11c3ed9b1d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.354138 Jun 27 15:50:12.188123 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 142/292] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:11 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:12.589580 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c1021169-f3c5-4932-ad94-2fcd012f1202 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:12.590227 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c1021169-f3c5-4932-ad94-2fcd012f1202 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:12.597937 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c1021169-f3c5-4932-ad94-2fcd012f1202 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:12.598634 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c1021169-f3c5-4932-ad94-2fcd012f1202 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:12.599652 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c1021169-f3c5-4932-ad94-2fcd012f1202 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:12.600312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c1021169-f3c5-4932-ad94-2fcd012f1202 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:13.208835 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-b69ccde4-7c04-4047-9c65-1be477b8351f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:13.210839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-b69ccde4-7c04-4047-9c65-1be477b8351f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:13.224328 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b69ccde4-7c04-4047-9c65-1be477b8351f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:13.225075 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b69ccde4-7c04-4047-9c65-1be477b8351f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:13.226112 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b69ccde4-7c04-4047-9c65-1be477b8351f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:13.226715 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b69ccde4-7c04-4047-9c65-1be477b8351f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:13.272262 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=100 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:13.282755 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-c1021169-f3c5-4932-ad94-2fcd012f1202 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:13.292756 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-c1021169-f3c5-4932-ad94-2fcd012f1202 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:13.294218 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-c1021169-f3c5-4932-ad94-2fcd012f1202 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:13.295750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c1021169-f3c5-4932-ad94-2fcd012f1202 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1599 microversion: 2.20 time: 0.713112 Jun 27 15:50:13.310820 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 151/293] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:50:12 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1599 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:50:13.318069 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-89fe7b3b-0c32-439a-810a-7963853cd41f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:13.318579 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-89fe7b3b-0c32-439a-810a-7963853cd41f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:13.326337 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-89fe7b3b-0c32-439a-810a-7963853cd41f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:13.326937 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-89fe7b3b-0c32-439a-810a-7963853cd41f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:13.327711 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-89fe7b3b-0c32-439a-810a-7963853cd41f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:13.328141 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-89fe7b3b-0c32-439a-810a-7963853cd41f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:13.520431 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-89fe7b3b-0c32-439a-810a-7963853cd41f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.208177 Jun 27 15:50:13.521218 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 152/294] 10.222.0.20 () {60 vars in 1315 bytes} [Mon Jun 27 15:50:13 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-interface => generated 284 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:50:13.632035 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b69ccde4-7c04-4047-9c65-1be477b8351f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:13.640892 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-b69ccde4-7c04-4047-9c65-1be477b8351f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.439064 Jun 27 15:50:13.641555 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 143/295] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:13 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:14.658725 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-1dde60aa-211b-42ac-bcc5-4b56314a4973 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:14.659971 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-1dde60aa-211b-42ac-bcc5-4b56314a4973 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:14.668637 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1dde60aa-211b-42ac-bcc5-4b56314a4973 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:14.669086 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1dde60aa-211b-42ac-bcc5-4b56314a4973 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:14.677589 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1dde60aa-211b-42ac-bcc5-4b56314a4973 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:14.678151 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1dde60aa-211b-42ac-bcc5-4b56314a4973 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:15.010336 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-1dde60aa-211b-42ac-bcc5-4b56314a4973 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:15.023864 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-1dde60aa-211b-42ac-bcc5-4b56314a4973 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.368962 Jun 27 15:50:15.034935 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 153/296] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:14 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:16.045954 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-fb3a31ad-5683-4fec-8c47-11e3cfa82533 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:16.047657 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-fb3a31ad-5683-4fec-8c47-11e3cfa82533 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:16.058769 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fb3a31ad-5683-4fec-8c47-11e3cfa82533 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:16.060035 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fb3a31ad-5683-4fec-8c47-11e3cfa82533 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:16.060995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fb3a31ad-5683-4fec-8c47-11e3cfa82533 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:16.061591 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fb3a31ad-5683-4fec-8c47-11e3cfa82533 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:16.316289 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0c78755e-0f1c-4af7-8475-79b42a5860f4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acb35c6e-5d63-46b7-9ae5-8a5a7c4637b1"}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:16.318760 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-0c78755e-0f1c-4af7-8475-79b42a5860f4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:16.328892 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0c78755e-0f1c-4af7-8475-79b42a5860f4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:16.329754 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0c78755e-0f1c-4af7-8475-79b42a5860f4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:16.330763 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0c78755e-0f1c-4af7-8475-79b42a5860f4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:16.331960 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0c78755e-0f1c-4af7-8475-79b42a5860f4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:16.363387 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-fb3a31ad-5683-4fec-8c47-11e3cfa82533 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:16.396513 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-fb3a31ad-5683-4fec-8c47-11e3cfa82533 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.358949 Jun 27 15:50:16.399341 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 144/297] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:16 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:16.766129 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-67720afc-d348-45e8-b04a-d993b1d41b2d req-927704e7-c206-4952-b18d-650ffa03fb0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9cda787-8842-478e-9fae-1c95d057875f", "tag": "cc266a26-7ff1-44ed-a332-b97209b03a63"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:16.780917 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-67720afc-d348-45e8-b04a-d993b1d41b2d req-927704e7-c206-4952-b18d-650ffa03fb0a service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:16.782524 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-67720afc-d348-45e8-b04a-d993b1d41b2d req-927704e7-c206-4952-b18d-650ffa03fb0a service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:16.813238 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-67720afc-d348-45e8-b04a-d993b1d41b2d req-927704e7-c206-4952-b18d-650ffa03fb0a service nova] Creating event network-changed:cc266a26-7ff1-44ed-a332-b97209b03a63 for instance b9cda787-8842-478e-9fae-1c95d057875f on hv-cinder-84780 Jun 27 15:50:16.827505 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-0c78755e-0f1c-4af7-8475-79b42a5860f4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "POST /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.523934 Jun 27 15:50:16.828247 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 154/298] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 27 15:50:16 2022] POST /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb/os-volume_attachments => generated 194 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:50:16.834488 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-67720afc-d348-45e8-b04a-d993b1d41b2d req-927704e7-c206-4952-b18d-650ffa03fb0a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070489 Jun 27 15:50:16.837020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 145/299] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:50:17.417779 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4b017dff-7aa7-421f-aab2-1e1928829237 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:17.418586 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-4b017dff-7aa7-421f-aab2-1e1928829237 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:17.435410 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4b017dff-7aa7-421f-aab2-1e1928829237 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:17.436791 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4b017dff-7aa7-421f-aab2-1e1928829237 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:17.439993 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4b017dff-7aa7-421f-aab2-1e1928829237 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:17.442772 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4b017dff-7aa7-421f-aab2-1e1928829237 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:17.784217 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4b017dff-7aa7-421f-aab2-1e1928829237 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:17.796473 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4b017dff-7aa7-421f-aab2-1e1928829237 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.383428 Jun 27 15:50:17.799232 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 155/300] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:17 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:18.816878 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d8531df8-a7dd-46b0-b9ae-ca4fb6cfd96c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:18.818388 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d8531df8-a7dd-46b0-b9ae-ca4fb6cfd96c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:18.834575 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d8531df8-a7dd-46b0-b9ae-ca4fb6cfd96c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:18.837673 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d8531df8-a7dd-46b0-b9ae-ca4fb6cfd96c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:18.840852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d8531df8-a7dd-46b0-b9ae-ca4fb6cfd96c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:18.841783 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d8531df8-a7dd-46b0-b9ae-ca4fb6cfd96c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:19.235638 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d8531df8-a7dd-46b0-b9ae-ca4fb6cfd96c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:19.249076 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d8531df8-a7dd-46b0-b9ae-ca4fb6cfd96c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.433455 Jun 27 15:50:19.260239 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 146/301] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:18 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:20.267980 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0521b1e6-c5a3-4f2d-8312-a72564aade00 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:20.269311 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-0521b1e6-c5a3-4f2d-8312-a72564aade00 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:20.280305 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0521b1e6-c5a3-4f2d-8312-a72564aade00 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:20.282059 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0521b1e6-c5a3-4f2d-8312-a72564aade00 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:20.283278 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0521b1e6-c5a3-4f2d-8312-a72564aade00 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:20.283872 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0521b1e6-c5a3-4f2d-8312-a72564aade00 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:20.450599 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-0521b1e6-c5a3-4f2d-8312-a72564aade00 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:20.463401 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-0521b1e6-c5a3-4f2d-8312-a72564aade00 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.199092 Jun 27 15:50:20.465025 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 156/302] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:20 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:20.692864 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-86546cab-884f-46f3-ac97-661e3afdf46c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Action: 'create', calling method: .version_select at 0x7fe145f1c820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-121267945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTDVAijHBbW5McfvbCVAte2Xf6JQVNMPt6TmVzBIUvQMQMct9I8DEGDgCV5AwKEQFhLOD5zofSxQnKCfpKlvtzjnAJsdZOwfhzebWcxW6kYzjp9f06DDq/ykUUE2F2doQ=="}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:20.706866 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-86546cab-884f-46f3-ac97-661e3afdf46c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Getting quotas for project ec9f767e3b4d4fb78f86a611ed9f47c5. Resources: {'key_pairs'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:50:20.710789 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-86546cab-884f-46f3-ac97-661e3afdf46c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Getting quotas for user 25024a505319480ab00f4c7e58de600c and project ec9f767e3b4d4fb78f86a611ed9f47c5. Resources: {'key_pairs'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:50:20.732551 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-86546cab-884f-46f3-ac97-661e3afdf46c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.237863 Jun 27 15:50:20.733319 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 147/303] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 27 15:50:20 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:50:21.279065 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a14a6bc7-df76-432a-87cf-f1af7d2d9ae3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-103437163", "imageRef": "11f9be98-90d6-4c67-8d66-0b944f5a2a2b", "flavorRef": "452", "networks": [{"uuid": "0f99c94d-8766-415b-910e-c27c88f40cf0"}]}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:21.345125 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.network.neutron [None req-a14a6bc7-df76-432a-87cf-f1af7d2d9ae3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] validate_networks() for [('0f99c94d-8766-415b-910e-c27c88f40cf0', None, None, None, None, None)] {{(pid=129473) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:50:21.482716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f036a217-fa4f-446f-b791-a8b82e113f35 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:21.483566 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f036a217-fa4f-446f-b791-a8b82e113f35 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:21.491952 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f036a217-fa4f-446f-b791-a8b82e113f35 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:21.492752 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f036a217-fa4f-446f-b791-a8b82e113f35 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:21.493735 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f036a217-fa4f-446f-b791-a8b82e113f35 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:21.494408 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f036a217-fa4f-446f-b791-a8b82e113f35 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:21.728433 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f036a217-fa4f-446f-b791-a8b82e113f35 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:21.736945 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f036a217-fa4f-446f-b791-a8b82e113f35 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.257998 Jun 27 15:50:21.747029 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 148/304] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:21 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:21.809949 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-a14a6bc7-df76-432a-87cf-f1af7d2d9ae3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Flavor limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:50:21.810366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-a14a6bc7-df76-432a-87cf-f1af7d2d9ae3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Image limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:50:21.810832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-a14a6bc7-df76-432a-87cf-f1af7d2d9ae3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Flavor pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:50:21.811230 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-a14a6bc7-df76-432a-87cf-f1af7d2d9ae3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Image pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:50:21.811634 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-a14a6bc7-df76-432a-87cf-f1af7d2d9ae3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:50:21.822167 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a14a6bc7-df76-432a-87cf-f1af7d2d9ae3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:21.822632 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a14a6bc7-df76-432a-87cf-f1af7d2d9ae3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:21.823442 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a14a6bc7-df76-432a-87cf-f1af7d2d9ae3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:21.823882 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a14a6bc7-df76-432a-87cf-f1af7d2d9ae3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:21.847262 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-a14a6bc7-df76-432a-87cf-f1af7d2d9ae3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Getting quotas for project 74b7ceb2cdb24fe0b504de90f017ce0f. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:50:21.851550 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-a14a6bc7-df76-432a-87cf-f1af7d2d9ae3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Getting quotas for user 0c60a904281841fc8773877812f0b8bc and project 74b7ceb2cdb24fe0b504de90f017ce0f. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:50:21.863636 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a14a6bc7-df76-432a-87cf-f1af7d2d9ae3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Going to run 1 instances... {{(pid=129473) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:50:21.866317 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a14a6bc7-df76-432a-87cf-f1af7d2d9ae3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11f9be98-90d6-4c67-8d66-0b944f5a2a2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:50:21.912780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a14a6bc7-df76-432a-87cf-f1af7d2d9ae3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637712 Jun 27 15:50:21.913412 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 157/305] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 15:50:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:50:21.924383 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d559b16d-834b-499b-bf67-5a939a2f6bcc tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:21.925894 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d559b16d-834b-499b-bf67-5a939a2f6bcc tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:21.998113 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d559b16d-834b-499b-bf67-5a939a2f6bcc tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:22.011842 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d559b16d-834b-499b-bf67-5a939a2f6bcc tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1213 microversion: 2.1 time: 0.091402 Jun 27 15:50:22.022442 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 149/306] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:21 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:22.755472 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-27060a12-4257-465c-8c21-60a3d765e20e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:22.756139 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-27060a12-4257-465c-8c21-60a3d765e20e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:22.765075 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-27060a12-4257-465c-8c21-60a3d765e20e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:22.765532 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-27060a12-4257-465c-8c21-60a3d765e20e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:22.766336 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-27060a12-4257-465c-8c21-60a3d765e20e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:22.766796 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-27060a12-4257-465c-8c21-60a3d765e20e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:22.918553 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-27060a12-4257-465c-8c21-60a3d765e20e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:22.927760 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-27060a12-4257-465c-8c21-60a3d765e20e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1502 microversion: 2.1 time: 0.177382 Jun 27 15:50:22.928338 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 158/307] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:22 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:22.959457 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-1c6f4017-d917-4e68-94bb-7c302dd764bd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee4a4b3c-125a-46c3-8232-36e9f4dad347"}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:22.962196 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-1c6f4017-d917-4e68-94bb-7c302dd764bd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:22.975095 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1c6f4017-d917-4e68-94bb-7c302dd764bd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:22.975894 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1c6f4017-d917-4e68-94bb-7c302dd764bd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:22.978008 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1c6f4017-d917-4e68-94bb-7c302dd764bd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:22.978840 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1c6f4017-d917-4e68-94bb-7c302dd764bd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:23.031930 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ae39e03f-912b-40e9-b2ea-8586acfcf606 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:23.033300 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-ae39e03f-912b-40e9-b2ea-8586acfcf606 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:23.034230 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-1c6f4017-d917-4e68-94bb-7c302dd764bd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] HTTP exception thrown: Cannot 'attach_volume' instance 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 while it is in vm_state rescued Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-1c6f4017-d917-4e68-94bb-7c302dd764bd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Request method failure captured: Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: POST /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5/os-volume_attachments HTTP/1.1 Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 74 Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudE47SqYCXFSdwZD2N57kXyxbMrtAm6wX1EHtWWUQlN--Jwn5T-qbUh8GEOB_fIgz7HnxVWw5uliaKnGFA9JAZI-vk9FE28h8V1LQOmG3Cr5YsOFNKtSr0bpkyXAEDcif6-AZEMpUP4PExRgpVR393bo3hncJYpBO41EPMQZDXHDQyI Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: f5e448e724fa479ea693168592686391 Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-852477413 Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:50:23.036427 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:50:23.044200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5e448e724fa479ea693168592686391"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5e448e724fa479ea693168592686391"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5e448e724fa479ea693168592686391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5e448e724fa479ea693168592686391", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:50:23.044200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-ServerRescueNegativeTestJSON-852477413 Jun 27 15:50:23.044200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: f5e448e724fa479ea693168592686391 Jun 27 15:50:23.044200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-852477413 Jun 27 15:50:23.044200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-ServerRescueNegativeTestJSON-852477413-project Jun 27 15:50:23.044200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:50:23.044200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:50:23.044200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: 1a7a81da8acf40849a9ea86e2542ae6a Jun 27 15:50:23.044200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-ServerRescueNegativeTestJSON-852477413-project Jun 27 15:50:23.044200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Jun 27 15:50:23.044200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {"volumeAttachment": {"volumeId": "ee4a4b3c-125a-46c3-8232-36e9f4dad347"}} Jun 27 15:50:23.044200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:50:23.045773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Cannot 'attach_volume' instance 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 while it is in vm_state rescued Jun 27 15:50:23.045773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'server_id': '985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5', 'body': {'volumeAttachment': {'volumeId': 'ee4a4b3c-125a-46c3-8232-36e9f4dad347'}}} Jun 27 15:50:23.045773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:50:23.045773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:50:23.045773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 15:50:23.045773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 15:50:23.045773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 15:50:23.045773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 15:50:23.045773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 27 15:50:23.045773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 27 15:50:23.045773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 27 15:50:23.045773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:50:23.045773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:50:23.045773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:50:23.045773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:50:23.045773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:50:23.045773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:50:23.045773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:50:23.045773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:50:23.048514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:50:23.048514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:50:23.048514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:50:23.048514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:50:23.048514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:50:23.048514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:50:23.048514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:50:23.048514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:50:23.048514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 27 15:50:23.048514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 27 15:50:23.048514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 27 15:50:23.048514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 27 15:50:23.048514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 while it is in vm_state rescued Jun 27 15:50:23.048514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:50:23.048514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:50:23.048514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:50:23.048514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:50:23.048514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:50:23.048514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:50:23.051394 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:50:23.051394 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:50:23.051394 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 while it is in vm_state rescued Jun 27 15:50:23.051394 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:50:23.051394 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-1c6f4017-d917-4e68-94bb-7c302dd764bd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Returning 409 to user: Cannot 'attach_volume' instance 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 while it is in vm_state rescued {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:50:23.051394 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-1c6f4017-d917-4e68-94bb-7c302dd764bd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "POST /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.087071 Jun 27 15:50:23.051394 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 150/308] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 27 15:50:22 2022] POST /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5/os-volume_attachments => generated 152 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 27 15:50:23.051394 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d46c7987-c846-4873-8765-c84fb539998d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:23.052436 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d46c7987-c846-4873-8765-c84fb539998d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:23.057873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d46c7987-c846-4873-8765-c84fb539998d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:23.058324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d46c7987-c846-4873-8765-c84fb539998d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:23.059101 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d46c7987-c846-4873-8765-c84fb539998d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:23.059536 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d46c7987-c846-4873-8765-c84fb539998d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:23.061396 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ae39e03f-912b-40e9-b2ea-8586acfcf606 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:23.062216 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ae39e03f-912b-40e9-b2ea-8586acfcf606 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:23.063518 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ae39e03f-912b-40e9-b2ea-8586acfcf606 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:23.064241 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ae39e03f-912b-40e9-b2ea-8586acfcf606 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:23.139542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-ae39e03f-912b-40e9-b2ea-8586acfcf606 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:23.149782 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d46c7987-c846-4873-8765-c84fb539998d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "POST /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5/action" status: 202 len: 0 microversion: 2.1 time: 0.104133 Jun 27 15:50:23.150848 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 151/309] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 27 15:50:23 2022] POST /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:50:23.155322 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-ae39e03f-912b-40e9-b2ea-8586acfcf606 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1217 microversion: 2.1 time: 0.130245 Jun 27 15:50:23.156147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 159/310] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:23 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:23.175955 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-b2d98bdf-e8a2-4367-8f90-8fb011f7df0b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:23.178272 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-b2d98bdf-e8a2-4367-8f90-8fb011f7df0b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:23.187847 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b2d98bdf-e8a2-4367-8f90-8fb011f7df0b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:23.188859 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b2d98bdf-e8a2-4367-8f90-8fb011f7df0b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:23.189797 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b2d98bdf-e8a2-4367-8f90-8fb011f7df0b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:23.191123 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b2d98bdf-e8a2-4367-8f90-8fb011f7df0b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:23.364956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b2d98bdf-e8a2-4367-8f90-8fb011f7df0b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:23.391625 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-b2d98bdf-e8a2-4367-8f90-8fb011f7df0b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1510 microversion: 2.1 time: 0.224569 Jun 27 15:50:23.393992 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 152/311] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:23 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1510 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:23.746200 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-1408b1f2-9ebb-434f-ba0c-440f7a1a3b7a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "864085aa-6547-4052-9075-a7fe78d453ec", "device": "/dev/sdb"}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:23.748543 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-1408b1f2-9ebb-434f-ba0c-440f7a1a3b7a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:23.751877 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:23.760897 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1408b1f2-9ebb-434f-ba0c-440f7a1a3b7a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:23.762070 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1408b1f2-9ebb-434f-ba0c-440f7a1a3b7a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:23.763048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1408b1f2-9ebb-434f-ba0c-440f7a1a3b7a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:23.763640 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1408b1f2-9ebb-434f-ba0c-440f7a1a3b7a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:24.181410 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d818ba23-ff48-41c4-a3a2-bfa622e26b91 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:24.182639 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d818ba23-ff48-41c4-a3a2-bfa622e26b91 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:24.189718 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d818ba23-ff48-41c4-a3a2-bfa622e26b91 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:24.190788 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d818ba23-ff48-41c4-a3a2-bfa622e26b91 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:24.192206 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d818ba23-ff48-41c4-a3a2-bfa622e26b91 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:24.192771 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d818ba23-ff48-41c4-a3a2-bfa622e26b91 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:24.264854 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d818ba23-ff48-41c4-a3a2-bfa622e26b91 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:24.275033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d818ba23-ff48-41c4-a3a2-bfa622e26b91 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1265 microversion: 2.1 time: 0.100883 Jun 27 15:50:24.275821 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 153/312] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:24 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1265 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:24.412544 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-06a9d05a-ff8b-435d-b81f-e9238dc6e141 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:24.413436 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-06a9d05a-ff8b-435d-b81f-e9238dc6e141 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:24.422678 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-06a9d05a-ff8b-435d-b81f-e9238dc6e141 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:24.427989 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-06a9d05a-ff8b-435d-b81f-e9238dc6e141 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:24.429405 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-06a9d05a-ff8b-435d-b81f-e9238dc6e141 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:24.431072 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-06a9d05a-ff8b-435d-b81f-e9238dc6e141 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:24.612455 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-1408b1f2-9ebb-434f-ba0c-440f7a1a3b7a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "POST /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.868305 Jun 27 15:50:24.618754 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 160/313] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 27 15:50:23 2022] POST /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7/os-volume_attachments => generated 194 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:50:24.680543 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-06a9d05a-ff8b-435d-b81f-e9238dc6e141 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:24.689278 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-06a9d05a-ff8b-435d-b81f-e9238dc6e141 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1510 microversion: 2.1 time: 0.281955 Jun 27 15:50:24.702000 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 154/314] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:24 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:24.716090 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e0290370-cb2b-443a-b1c5-de403c9ee4be tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:24.723003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e0290370-cb2b-443a-b1c5-de403c9ee4be tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:24.723442 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e0290370-cb2b-443a-b1c5-de403c9ee4be tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:24.790653 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e0290370-cb2b-443a-b1c5-de403c9ee4be tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Going to try to stop instance {{(pid=129473) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 27 15:50:24.810744 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:24.842922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e0290370-cb2b-443a-b1c5-de403c9ee4be tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "POST /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb/action" status: 202 len: 0 microversion: 2.1 time: 0.131315 Jun 27 15:50:24.843534 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 161/315] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 27 15:50:24 2022] POST /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:50:24.852471 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-648c1f1d-d6df-4226-9743-0b5ed9d7aa2c tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:24.861696 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-648c1f1d-d6df-4226-9743-0b5ed9d7aa2c tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:24.870574 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-648c1f1d-d6df-4226-9743-0b5ed9d7aa2c tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:24.871406 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-648c1f1d-d6df-4226-9743-0b5ed9d7aa2c tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:24.872588 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-648c1f1d-d6df-4226-9743-0b5ed9d7aa2c tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:24.873220 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-648c1f1d-d6df-4226-9743-0b5ed9d7aa2c tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:25.120370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-648c1f1d-d6df-4226-9743-0b5ed9d7aa2c tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:25.129680 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-648c1f1d-d6df-4226-9743-0b5ed9d7aa2c tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.280811 Jun 27 15:50:25.130767 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 155/316] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:24 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:25.294771 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-08109b87-4c06-4f8b-b733-d630fbbed5b7 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:25.295710 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-08109b87-4c06-4f8b-b733-d630fbbed5b7 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:25.303190 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-08109b87-4c06-4f8b-b733-d630fbbed5b7 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:25.303860 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-08109b87-4c06-4f8b-b733-d630fbbed5b7 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:25.304812 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-08109b87-4c06-4f8b-b733-d630fbbed5b7 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:25.305395 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-08109b87-4c06-4f8b-b733-d630fbbed5b7 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:25.427541 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-08109b87-4c06-4f8b-b733-d630fbbed5b7 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:25.436188 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-08109b87-4c06-4f8b-b733-d630fbbed5b7 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1283 microversion: 2.1 time: 0.146135 Jun 27 15:50:25.447532 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 162/317] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:25 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1283 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:25.710506 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-6c299b34-6e87-4edc-9aa4-a59fbf79f65a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:25.711925 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-6c299b34-6e87-4edc-9aa4-a59fbf79f65a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:25.720109 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6c299b34-6e87-4edc-9aa4-a59fbf79f65a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:25.720567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6c299b34-6e87-4edc-9aa4-a59fbf79f65a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:25.722983 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6c299b34-6e87-4edc-9aa4-a59fbf79f65a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:25.723850 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6c299b34-6e87-4edc-9aa4-a59fbf79f65a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:25.894475 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-6c299b34-6e87-4edc-9aa4-a59fbf79f65a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:25.902233 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-6c299b34-6e87-4edc-9aa4-a59fbf79f65a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1510 microversion: 2.1 time: 0.198351 Jun 27 15:50:25.903139 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 156/318] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:25 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1510 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:26.148945 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a0ef2dc0-74ff-4ba3-823f-f93c651807ec tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:26.150342 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a0ef2dc0-74ff-4ba3-823f-f93c651807ec tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:26.157283 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a0ef2dc0-74ff-4ba3-823f-f93c651807ec tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:26.157871 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a0ef2dc0-74ff-4ba3-823f-f93c651807ec tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:26.158750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a0ef2dc0-74ff-4ba3-823f-f93c651807ec tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:26.160022 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a0ef2dc0-74ff-4ba3-823f-f93c651807ec tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:26.327294 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a0ef2dc0-74ff-4ba3-823f-f93c651807ec tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:26.335991 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a0ef2dc0-74ff-4ba3-823f-f93c651807ec tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.190913 Jun 27 15:50:26.336558 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 163/319] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:26 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:26.455387 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-832eb57a-f8ff-4d91-b350-fa296d823913 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:26.457094 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-832eb57a-f8ff-4d91-b350-fa296d823913 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:26.463918 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-832eb57a-f8ff-4d91-b350-fa296d823913 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:26.464359 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-832eb57a-f8ff-4d91-b350-fa296d823913 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:26.465122 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-832eb57a-f8ff-4d91-b350-fa296d823913 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:26.465548 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-832eb57a-f8ff-4d91-b350-fa296d823913 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:26.603884 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-832eb57a-f8ff-4d91-b350-fa296d823913 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:26.611283 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-832eb57a-f8ff-4d91-b350-fa296d823913 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1313 microversion: 2.1 time: 0.160609 Jun 27 15:50:26.611853 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 157/320] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:26 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:26.919663 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b64ee207-b51f-4c53-acef-99767189f0b9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:26.920263 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b64ee207-b51f-4c53-acef-99767189f0b9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:26.927266 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b64ee207-b51f-4c53-acef-99767189f0b9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:26.927714 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b64ee207-b51f-4c53-acef-99767189f0b9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:26.928486 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b64ee207-b51f-4c53-acef-99767189f0b9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:26.928926 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b64ee207-b51f-4c53-acef-99767189f0b9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:27.061526 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b64ee207-b51f-4c53-acef-99767189f0b9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:27.069687 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b64ee207-b51f-4c53-acef-99767189f0b9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1510 microversion: 2.1 time: 0.153777 Jun 27 15:50:27.070275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 164/321] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:26 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:27.353166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-b0e3762a-5752-4040-ac6d-7b4d270de87b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:27.353944 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-b0e3762a-5752-4040-ac6d-7b4d270de87b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:27.360934 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b0e3762a-5752-4040-ac6d-7b4d270de87b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:27.361386 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b0e3762a-5752-4040-ac6d-7b4d270de87b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:27.363156 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b0e3762a-5752-4040-ac6d-7b4d270de87b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:27.363608 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b0e3762a-5752-4040-ac6d-7b4d270de87b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:27.500260 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b0e3762a-5752-4040-ac6d-7b4d270de87b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:27.508240 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-b0e3762a-5752-4040-ac6d-7b4d270de87b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.159025 Jun 27 15:50:27.508798 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 158/322] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:27 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:27.630002 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-bf4bead4-4aca-40cb-a766-fa93bdc8b3f6 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:27.630605 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-bf4bead4-4aca-40cb-a766-fa93bdc8b3f6 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:27.636953 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bf4bead4-4aca-40cb-a766-fa93bdc8b3f6 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:27.637396 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bf4bead4-4aca-40cb-a766-fa93bdc8b3f6 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:27.638192 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bf4bead4-4aca-40cb-a766-fa93bdc8b3f6 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:27.638792 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bf4bead4-4aca-40cb-a766-fa93bdc8b3f6 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:27.778989 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-bf4bead4-4aca-40cb-a766-fa93bdc8b3f6 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:27.786922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-bf4bead4-4aca-40cb-a766-fa93bdc8b3f6 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1313 microversion: 2.1 time: 0.160929 Jun 27 15:50:27.787494 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 165/323] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:27 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:28.086111 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-4a62f9e9-abaa-4b35-af0d-9eb615fe63cf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:28.087128 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-4a62f9e9-abaa-4b35-af0d-9eb615fe63cf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:28.094224 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4a62f9e9-abaa-4b35-af0d-9eb615fe63cf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:28.094853 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4a62f9e9-abaa-4b35-af0d-9eb615fe63cf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:28.095747 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4a62f9e9-abaa-4b35-af0d-9eb615fe63cf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:28.097202 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4a62f9e9-abaa-4b35-af0d-9eb615fe63cf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:28.210288 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-1a7063a2-6a31-478c-8a73-7002b3288479 req-62ce91a2-0c5a-4c9e-96c3-38bb36c7ca57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1639393-7ae9-4f69-8a8d-abc1a3eb39f6", "tag": "68739089-04a5-41a8-a31e-72e08096b056"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:28.227618 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-1a7063a2-6a31-478c-8a73-7002b3288479 req-62ce91a2-0c5a-4c9e-96c3-38bb36c7ca57 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:28.228080 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-1a7063a2-6a31-478c-8a73-7002b3288479 req-62ce91a2-0c5a-4c9e-96c3-38bb36c7ca57 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:28.241616 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-1a7063a2-6a31-478c-8a73-7002b3288479 req-62ce91a2-0c5a-4c9e-96c3-38bb36c7ca57 service nova] Creating event network-changed:68739089-04a5-41a8-a31e-72e08096b056 for instance e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 on hv-cinder-84780 Jun 27 15:50:28.247877 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-1a7063a2-6a31-478c-8a73-7002b3288479 req-62ce91a2-0c5a-4c9e-96c3-38bb36c7ca57 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043483 Jun 27 15:50:28.249132 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 166/324] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:50:28.272492 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-4a62f9e9-abaa-4b35-af0d-9eb615fe63cf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:28.280051 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-4a62f9e9-abaa-4b35-af0d-9eb615fe63cf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1516 microversion: 2.1 time: 0.197828 Jun 27 15:50:28.280616 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 159/325] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:28 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:28.526445 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0bee51fb-9481-4518-aa0f-f282da8490d7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:28.527166 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-0bee51fb-9481-4518-aa0f-f282da8490d7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:28.542712 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0bee51fb-9481-4518-aa0f-f282da8490d7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:28.542712 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0bee51fb-9481-4518-aa0f-f282da8490d7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:28.542712 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0bee51fb-9481-4518-aa0f-f282da8490d7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:28.542712 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0bee51fb-9481-4518-aa0f-f282da8490d7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:28.710140 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-0bee51fb-9481-4518-aa0f-f282da8490d7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:28.718467 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-0bee51fb-9481-4518-aa0f-f282da8490d7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.196423 Jun 27 15:50:28.719023 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 167/326] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:28 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:28.805065 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-e19fdcc7-87b0-4795-95dc-d9181816e8b2 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:28.806317 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-e19fdcc7-87b0-4795-95dc-d9181816e8b2 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:28.812677 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e19fdcc7-87b0-4795-95dc-d9181816e8b2 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:28.813256 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e19fdcc7-87b0-4795-95dc-d9181816e8b2 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:28.814066 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e19fdcc7-87b0-4795-95dc-d9181816e8b2 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:28.814496 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e19fdcc7-87b0-4795-95dc-d9181816e8b2 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:28.951473 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-e19fdcc7-87b0-4795-95dc-d9181816e8b2 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:28.961379 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-e19fdcc7-87b0-4795-95dc-d9181816e8b2 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1313 microversion: 2.1 time: 0.160409 Jun 27 15:50:28.961950 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 160/327] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:28 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:29.662005 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c528d3db-e25e-451d-aef3-3e9e81f5061a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Action: 'create', calling method: .version_select at 0x7fe147993e50>, body: {"keypair": {"name": "tempest-keypair-167403970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGr7A67v0Mw2tcq6iEG3qONA9C8eXjqxg/P9POUZYUurtseqEWZzpEeIh2cR8QbZgrRZMJYcyB74YxCEGVaV3cAGe196k/Dqj9GQCAlDibyp1mV8y1mTZyoyNHbM7WOZQ=="}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:29.680493 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-c528d3db-e25e-451d-aef3-3e9e81f5061a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Getting quotas for project f5e448e724fa479ea693168592686391. Resources: {'key_pairs'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:50:29.685804 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-c528d3db-e25e-451d-aef3-3e9e81f5061a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Getting quotas for user 1a7a81da8acf40849a9ea86e2542ae6a and project f5e448e724fa479ea693168592686391. Resources: {'key_pairs'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:50:29.711325 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c528d3db-e25e-451d-aef3-3e9e81f5061a tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053115 Jun 27 15:50:29.712355 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 168/328] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 27 15:50:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:50:29.739382 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-b9dd4cc9-62d3-4b22-a137-db682ab2dc5d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:29.740094 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-b9dd4cc9-62d3-4b22-a137-db682ab2dc5d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:29.742288 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:29.750546 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b9dd4cc9-62d3-4b22-a137-db682ab2dc5d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:29.751333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b9dd4cc9-62d3-4b22-a137-db682ab2dc5d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:29.752271 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b9dd4cc9-62d3-4b22-a137-db682ab2dc5d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:29.752592 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b9dd4cc9-62d3-4b22-a137-db682ab2dc5d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:29.979637 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b497664d-f21a-44db-bf99-e735af200189 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:29.980249 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b497664d-f21a-44db-bf99-e735af200189 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:29.995443 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b9dd4cc9-62d3-4b22-a137-db682ab2dc5d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:30.003998 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-b9dd4cc9-62d3-4b22-a137-db682ab2dc5d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.271164 Jun 27 15:50:30.007708 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b497664d-f21a-44db-bf99-e735af200189 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:30.008965 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 161/329] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:29 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:30.009363 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b497664d-f21a-44db-bf99-e735af200189 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:30.010225 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b497664d-f21a-44db-bf99-e735af200189 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:30.010591 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b497664d-f21a-44db-bf99-e735af200189 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:30.184854 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b497664d-f21a-44db-bf99-e735af200189 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:30.196787 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b497664d-f21a-44db-bf99-e735af200189 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1313 microversion: 2.1 time: 0.220764 Jun 27 15:50:30.197872 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 169/330] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:29 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:31.025800 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9dfa9728-a3ec-43fe-969f-5a20889176d5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:31.026455 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9dfa9728-a3ec-43fe-969f-5a20889176d5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:31.034324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9dfa9728-a3ec-43fe-969f-5a20889176d5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:31.035281 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9dfa9728-a3ec-43fe-969f-5a20889176d5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:31.036361 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9dfa9728-a3ec-43fe-969f-5a20889176d5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:31.036818 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9dfa9728-a3ec-43fe-969f-5a20889176d5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:31.043174 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:31.215693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-361688c7-4bed-4426-af65-db324b8a25ff tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:31.216457 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-361688c7-4bed-4426-af65-db324b8a25ff tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:31.226313 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-361688c7-4bed-4426-af65-db324b8a25ff tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:31.227261 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-361688c7-4bed-4426-af65-db324b8a25ff tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:31.228378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-361688c7-4bed-4426-af65-db324b8a25ff tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:31.229001 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-361688c7-4bed-4426-af65-db324b8a25ff tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:31.344521 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9dfa9728-a3ec-43fe-969f-5a20889176d5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:31.355599 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9dfa9728-a3ec-43fe-969f-5a20889176d5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.333249 Jun 27 15:50:31.366166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 162/331] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:31 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:31.755954 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-361688c7-4bed-4426-af65-db324b8a25ff tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:31.763740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-361688c7-4bed-4426-af65-db324b8a25ff tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1313 microversion: 2.1 time: 0.552516 Jun 27 15:50:31.764467 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 170/332] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:31 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1313 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:31.852222 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d666c202-d0f0-4d46-ab50-168c9431a822 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-309879994", "imageRef": "11f9be98-90d6-4c67-8d66-0b944f5a2a2b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b3c98a4-e5c9-4af6-926d-da3be9d57070"}], "security_groups": [{"name": "tempest-securitygroup--512019847"}], "key_name": "tempest-keypair-167403970", "user_data": "}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:31.970497 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.network.neutron [None req-d666c202-d0f0-4d46-ab50-168c9431a822 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] validate_networks() for [('3b3c98a4-e5c9-4af6-926d-da3be9d57070', None, None, None, None, None)] {{(pid=129472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:50:32.011456 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=6 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:32.374126 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f914de09-08df-4e5d-a7cb-b99ec5585680 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:32.374818 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f914de09-08df-4e5d-a7cb-b99ec5585680 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:32.376726 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=2 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:32.383303 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f914de09-08df-4e5d-a7cb-b99ec5585680 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:32.383969 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f914de09-08df-4e5d-a7cb-b99ec5585680 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:32.384497 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-d666c202-d0f0-4d46-ab50-168c9431a822 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Flavor limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:50:32.385098 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f914de09-08df-4e5d-a7cb-b99ec5585680 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:32.385196 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-d666c202-d0f0-4d46-ab50-168c9431a822 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Image limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:50:32.385286 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f914de09-08df-4e5d-a7cb-b99ec5585680 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:32.385602 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-d666c202-d0f0-4d46-ab50-168c9431a822 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Flavor pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:50:32.386060 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-d666c202-d0f0-4d46-ab50-168c9431a822 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Image pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:50:32.386672 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-d666c202-d0f0-4d46-ab50-168c9431a822 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:50:32.404212 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d666c202-d0f0-4d46-ab50-168c9431a822 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:32.404658 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d666c202-d0f0-4d46-ab50-168c9431a822 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:32.405455 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d666c202-d0f0-4d46-ab50-168c9431a822 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:32.406124 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d666c202-d0f0-4d46-ab50-168c9431a822 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:32.427874 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-d666c202-d0f0-4d46-ab50-168c9431a822 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Getting quotas for project f5e448e724fa479ea693168592686391. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:50:32.433042 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-d666c202-d0f0-4d46-ab50-168c9431a822 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Getting quotas for user 1a7a81da8acf40849a9ea86e2542ae6a and project f5e448e724fa479ea693168592686391. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:50:32.446631 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d666c202-d0f0-4d46-ab50-168c9431a822 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Going to run 1 instances... {{(pid=129472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:50:32.448951 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d666c202-d0f0-4d46-ab50-168c9431a822 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11f9be98-90d6-4c67-8d66-0b944f5a2a2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:50:32.515980 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d666c202-d0f0-4d46-ab50-168c9431a822 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.667935 Jun 27 15:50:32.517697 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 163/333] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 15:50:31 2022] POST /compute/v2.1/servers => generated 408 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:50:32.528173 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d3ba6e1d-6abc-4d94-9faf-86f51c211c03 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:32.537390 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d3ba6e1d-6abc-4d94-9faf-86f51c211c03 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:32.604297 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d3ba6e1d-6abc-4d94-9faf-86f51c211c03 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:32.605061 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f914de09-08df-4e5d-a7cb-b99ec5585680 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:32.613924 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f914de09-08df-4e5d-a7cb-b99ec5585680 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.243613 Jun 27 15:50:32.615166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d3ba6e1d-6abc-4d94-9faf-86f51c211c03 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1244 microversion: 2.1 time: 0.091294 Jun 27 15:50:32.625425 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 164/334] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:32 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1244 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:32.625611 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 171/335] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:32 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:32.782047 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-cfcd7d37-3309-4423-a467-800a1f5faf65 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:32.782759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-cfcd7d37-3309-4423-a467-800a1f5faf65 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:32.790436 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cfcd7d37-3309-4423-a467-800a1f5faf65 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:32.790884 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cfcd7d37-3309-4423-a467-800a1f5faf65 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:32.791655 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cfcd7d37-3309-4423-a467-800a1f5faf65 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:32.792346 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cfcd7d37-3309-4423-a467-800a1f5faf65 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:32.983566 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-cfcd7d37-3309-4423-a467-800a1f5faf65 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:32.992230 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-cfcd7d37-3309-4423-a467-800a1f5faf65 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1313 microversion: 2.1 time: 0.213861 Jun 27 15:50:32.992832 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 165/336] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:32 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:33.633127 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-326fe1df-ee3a-4b78-a07a-d97f3057aaa7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:33.634527 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-326fe1df-ee3a-4b78-a07a-d97f3057aaa7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:33.637212 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d45f7011-21fb-446a-a4bf-9a53ee83c1d6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:33.637859 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d45f7011-21fb-446a-a4bf-9a53ee83c1d6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:33.641737 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-326fe1df-ee3a-4b78-a07a-d97f3057aaa7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:33.642189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-326fe1df-ee3a-4b78-a07a-d97f3057aaa7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:33.643522 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-326fe1df-ee3a-4b78-a07a-d97f3057aaa7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:33.644107 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-326fe1df-ee3a-4b78-a07a-d97f3057aaa7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:33.645491 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d45f7011-21fb-446a-a4bf-9a53ee83c1d6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:33.645974 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d45f7011-21fb-446a-a4bf-9a53ee83c1d6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:33.646753 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d45f7011-21fb-446a-a4bf-9a53ee83c1d6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:33.647185 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d45f7011-21fb-446a-a4bf-9a53ee83c1d6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:33.742660 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d45f7011-21fb-446a-a4bf-9a53ee83c1d6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:33.751617 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d45f7011-21fb-446a-a4bf-9a53ee83c1d6 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1248 microversion: 2.1 time: 0.120815 Jun 27 15:50:33.752210 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 166/337] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:33 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1248 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:33.828469 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-326fe1df-ee3a-4b78-a07a-d97f3057aaa7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:33.837376 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-326fe1df-ee3a-4b78-a07a-d97f3057aaa7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.209715 Jun 27 15:50:33.837990 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 172/338] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:33 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:34.010332 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-5598dcd2-a41f-46d4-9e69-3fb5ac229dd4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:34.010967 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-5598dcd2-a41f-46d4-9e69-3fb5ac229dd4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:34.016972 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5598dcd2-a41f-46d4-9e69-3fb5ac229dd4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:34.017437 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5598dcd2-a41f-46d4-9e69-3fb5ac229dd4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:34.019666 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5598dcd2-a41f-46d4-9e69-3fb5ac229dd4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:34.020007 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5598dcd2-a41f-46d4-9e69-3fb5ac229dd4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:34.163652 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-5598dcd2-a41f-46d4-9e69-3fb5ac229dd4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:34.172451 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-5598dcd2-a41f-46d4-9e69-3fb5ac229dd4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1313 microversion: 2.1 time: 0.165884 Jun 27 15:50:34.173016 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 167/339] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:34 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:34.770640 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e26de77f-8ab1-431a-b661-7e5f537da905 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:34.771190 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e26de77f-8ab1-431a-b661-7e5f537da905 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:34.777909 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e26de77f-8ab1-431a-b661-7e5f537da905 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:34.778348 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e26de77f-8ab1-431a-b661-7e5f537da905 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:34.779356 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e26de77f-8ab1-431a-b661-7e5f537da905 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:34.780013 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e26de77f-8ab1-431a-b661-7e5f537da905 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:34.858321 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-cb94e700-53ab-4c20-8c2b-46a8b14cf9d7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:34.859446 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-cb94e700-53ab-4c20-8c2b-46a8b14cf9d7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:34.859779 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e26de77f-8ab1-431a-b661-7e5f537da905 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:34.868484 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e26de77f-8ab1-431a-b661-7e5f537da905 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1248 microversion: 2.1 time: 0.102737 Jun 27 15:50:34.868701 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cb94e700-53ab-4c20-8c2b-46a8b14cf9d7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:34.869693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 173/340] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:34 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1248 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:34.869832 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cb94e700-53ab-4c20-8c2b-46a8b14cf9d7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:34.871186 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cb94e700-53ab-4c20-8c2b-46a8b14cf9d7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:34.871986 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cb94e700-53ab-4c20-8c2b-46a8b14cf9d7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:35.034264 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-cb94e700-53ab-4c20-8c2b-46a8b14cf9d7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:35.042711 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-cb94e700-53ab-4c20-8c2b-46a8b14cf9d7 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.190980 Jun 27 15:50:35.043291 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 168/341] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:34 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:35.192672 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-828b01f5-b0c2-484b-9356-b8e4fc53c046 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:35.194054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-828b01f5-b0c2-484b-9356-b8e4fc53c046 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:35.205083 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-828b01f5-b0c2-484b-9356-b8e4fc53c046 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:35.205895 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-828b01f5-b0c2-484b-9356-b8e4fc53c046 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:35.207327 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-828b01f5-b0c2-484b-9356-b8e4fc53c046 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:35.208096 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-828b01f5-b0c2-484b-9356-b8e4fc53c046 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:35.356050 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-828b01f5-b0c2-484b-9356-b8e4fc53c046 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:35.364553 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-828b01f5-b0c2-484b-9356-b8e4fc53c046 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1313 microversion: 2.1 time: 0.177748 Jun 27 15:50:35.365153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 174/342] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:35 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:35.897101 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-612852a9-030b-4818-bf4e-43c089161133 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:35.898296 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-612852a9-030b-4818-bf4e-43c089161133 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:35.906518 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-612852a9-030b-4818-bf4e-43c089161133 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:35.907087 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-612852a9-030b-4818-bf4e-43c089161133 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:35.907948 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-612852a9-030b-4818-bf4e-43c089161133 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:35.908459 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-612852a9-030b-4818-bf4e-43c089161133 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:35.985437 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-612852a9-030b-4818-bf4e-43c089161133 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:35.994250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-612852a9-030b-4818-bf4e-43c089161133 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1240 microversion: 2.1 time: 0.105224 Jun 27 15:50:35.994836 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 169/343] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:35 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1240 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:36.064374 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d35f5a24-ca95-4988-9042-ccc8b6c37393 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:36.065339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d35f5a24-ca95-4988-9042-ccc8b6c37393 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:36.075980 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d35f5a24-ca95-4988-9042-ccc8b6c37393 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:36.076720 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d35f5a24-ca95-4988-9042-ccc8b6c37393 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:36.078032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d35f5a24-ca95-4988-9042-ccc8b6c37393 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:36.078827 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d35f5a24-ca95-4988-9042-ccc8b6c37393 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:36.239398 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d35f5a24-ca95-4988-9042-ccc8b6c37393 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:36.247967 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d35f5a24-ca95-4988-9042-ccc8b6c37393 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.190343 Jun 27 15:50:36.248534 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 175/344] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:36 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:36.382372 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-234b9c73-323c-4d36-9fe1-627694b1647e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:36.382996 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-234b9c73-323c-4d36-9fe1-627694b1647e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:36.389058 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-234b9c73-323c-4d36-9fe1-627694b1647e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:36.389511 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-234b9c73-323c-4d36-9fe1-627694b1647e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:36.390314 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-234b9c73-323c-4d36-9fe1-627694b1647e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:36.390751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-234b9c73-323c-4d36-9fe1-627694b1647e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:36.538945 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-234b9c73-323c-4d36-9fe1-627694b1647e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:36.547221 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-234b9c73-323c-4d36-9fe1-627694b1647e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1313 microversion: 2.1 time: 0.169521 Jun 27 15:50:36.547815 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 170/345] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:36 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:37.012261 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-580bf59a-bff2-4ff1-a2db-7851b13a0fc4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:37.012961 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-580bf59a-bff2-4ff1-a2db-7851b13a0fc4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:37.023201 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-580bf59a-bff2-4ff1-a2db-7851b13a0fc4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:37.023656 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-580bf59a-bff2-4ff1-a2db-7851b13a0fc4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:37.024442 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-580bf59a-bff2-4ff1-a2db-7851b13a0fc4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:37.024886 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-580bf59a-bff2-4ff1-a2db-7851b13a0fc4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:37.097037 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-580bf59a-bff2-4ff1-a2db-7851b13a0fc4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:37.106158 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-580bf59a-bff2-4ff1-a2db-7851b13a0fc4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1296 microversion: 2.1 time: 0.097941 Jun 27 15:50:37.107370 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 176/346] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:37 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1296 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:37.266499 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3513b32d-7b7a-4cd6-8f97-773ecd703f07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:37.267110 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3513b32d-7b7a-4cd6-8f97-773ecd703f07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:37.275112 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3513b32d-7b7a-4cd6-8f97-773ecd703f07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:37.275560 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3513b32d-7b7a-4cd6-8f97-773ecd703f07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:37.276327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3513b32d-7b7a-4cd6-8f97-773ecd703f07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:37.276758 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3513b32d-7b7a-4cd6-8f97-773ecd703f07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:37.419449 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3513b32d-7b7a-4cd6-8f97-773ecd703f07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:37.428544 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3513b32d-7b7a-4cd6-8f97-773ecd703f07 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.165893 Jun 27 15:50:37.429119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 171/347] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:37 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:37.563780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3f224270-7de7-4165-8c98-5cb889b1b345 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:37.564386 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3f224270-7de7-4165-8c98-5cb889b1b345 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:37.571138 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3f224270-7de7-4165-8c98-5cb889b1b345 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:37.571581 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3f224270-7de7-4165-8c98-5cb889b1b345 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:37.572344 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3f224270-7de7-4165-8c98-5cb889b1b345 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:37.572774 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3f224270-7de7-4165-8c98-5cb889b1b345 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:37.715011 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3f224270-7de7-4165-8c98-5cb889b1b345 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:37.723139 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3f224270-7de7-4165-8c98-5cb889b1b345 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1313 microversion: 2.1 time: 0.163146 Jun 27 15:50:37.723728 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 177/348] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:37 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:38.126648 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-4d78ab6b-3fba-4dde-b476-0a40e4f4110e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:38.127330 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-4d78ab6b-3fba-4dde-b476-0a40e4f4110e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:38.134218 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4d78ab6b-3fba-4dde-b476-0a40e4f4110e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:38.134656 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4d78ab6b-3fba-4dde-b476-0a40e4f4110e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:38.135429 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4d78ab6b-3fba-4dde-b476-0a40e4f4110e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:38.136242 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4d78ab6b-3fba-4dde-b476-0a40e4f4110e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:38.217500 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-4d78ab6b-3fba-4dde-b476-0a40e4f4110e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:38.227265 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-4d78ab6b-3fba-4dde-b476-0a40e4f4110e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1296 microversion: 2.1 time: 0.105685 Jun 27 15:50:38.229724 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 172/349] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:38 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1296 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:38.446408 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-7377d61c-3aba-44bb-bef4-31879cb6adef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:38.447634 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-7377d61c-3aba-44bb-bef4-31879cb6adef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:38.455826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7377d61c-3aba-44bb-bef4-31879cb6adef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:38.456703 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7377d61c-3aba-44bb-bef4-31879cb6adef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:38.458427 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7377d61c-3aba-44bb-bef4-31879cb6adef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:38.459188 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7377d61c-3aba-44bb-bef4-31879cb6adef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:38.610143 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-7377d61c-3aba-44bb-bef4-31879cb6adef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:38.619322 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-7377d61c-3aba-44bb-bef4-31879cb6adef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.177242 Jun 27 15:50:38.619985 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 178/350] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:38 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:38.740792 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3dd2ab68-a13f-4af1-924b-d66ff1b95be5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:38.741391 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3dd2ab68-a13f-4af1-924b-d66ff1b95be5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:38.748728 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3dd2ab68-a13f-4af1-924b-d66ff1b95be5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:38.749178 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3dd2ab68-a13f-4af1-924b-d66ff1b95be5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:38.750058 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3dd2ab68-a13f-4af1-924b-d66ff1b95be5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:38.750494 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3dd2ab68-a13f-4af1-924b-d66ff1b95be5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:38.903545 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3dd2ab68-a13f-4af1-924b-d66ff1b95be5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:38.911647 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3dd2ab68-a13f-4af1-924b-d66ff1b95be5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1313 microversion: 2.1 time: 0.175406 Jun 27 15:50:38.912217 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 173/351] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:38 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:39.247009 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4b66db34-2436-409f-a204-ddc3ae10499b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:39.247853 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-4b66db34-2436-409f-a204-ddc3ae10499b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:39.262921 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4b66db34-2436-409f-a204-ddc3ae10499b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:39.263490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4b66db34-2436-409f-a204-ddc3ae10499b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:39.264390 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4b66db34-2436-409f-a204-ddc3ae10499b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:39.264924 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4b66db34-2436-409f-a204-ddc3ae10499b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:39.281047 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:39.339767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4b66db34-2436-409f-a204-ddc3ae10499b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:39.349251 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4b66db34-2436-409f-a204-ddc3ae10499b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1302 microversion: 2.1 time: 0.106036 Jun 27 15:50:39.349839 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 179/352] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:39 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1302 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:39.636400 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-93d5ed3c-8f14-4bfc-bf4d-6557e739de68 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:39.637111 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-93d5ed3c-8f14-4bfc-bf4d-6557e739de68 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:39.643950 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-93d5ed3c-8f14-4bfc-bf4d-6557e739de68 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:39.644850 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-93d5ed3c-8f14-4bfc-bf4d-6557e739de68 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:39.645782 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-93d5ed3c-8f14-4bfc-bf4d-6557e739de68 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:39.646306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-93d5ed3c-8f14-4bfc-bf4d-6557e739de68 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:39.790309 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-93d5ed3c-8f14-4bfc-bf4d-6557e739de68 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:39.798701 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-93d5ed3c-8f14-4bfc-bf4d-6557e739de68 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.166136 Jun 27 15:50:39.799862 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 174/353] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:39 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:39.929066 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ce65fc91-4637-4ba1-95ae-5d173411bb26 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:39.929704 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-ce65fc91-4637-4ba1-95ae-5d173411bb26 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:39.931955 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=10 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:39.937306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ce65fc91-4637-4ba1-95ae-5d173411bb26 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:39.937770 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ce65fc91-4637-4ba1-95ae-5d173411bb26 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:39.938532 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ce65fc91-4637-4ba1-95ae-5d173411bb26 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:39.938963 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ce65fc91-4637-4ba1-95ae-5d173411bb26 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:40.075359 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-ce65fc91-4637-4ba1-95ae-5d173411bb26 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:40.083582 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-ce65fc91-4637-4ba1-95ae-5d173411bb26 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1313 microversion: 2.1 time: 0.158381 Jun 27 15:50:40.084154 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 180/354] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:39 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:40.367465 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ef691ca0-c7d0-4144-802a-9bdc76d4698b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:40.368111 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-ef691ca0-c7d0-4144-802a-9bdc76d4698b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:40.374692 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ef691ca0-c7d0-4144-802a-9bdc76d4698b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:40.375141 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ef691ca0-c7d0-4144-802a-9bdc76d4698b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:40.375921 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ef691ca0-c7d0-4144-802a-9bdc76d4698b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:40.376343 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ef691ca0-c7d0-4144-802a-9bdc76d4698b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:40.519788 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ef691ca0-c7d0-4144-802a-9bdc76d4698b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:40.527159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ef691ca0-c7d0-4144-802a-9bdc76d4698b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1369 microversion: 2.1 time: 0.163741 Jun 27 15:50:40.527753 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 175/355] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:40 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:40.816811 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-6c806833-2726-4de3-b6b8-ed0c58f3dbd4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:40.817329 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-6c806833-2726-4de3-b6b8-ed0c58f3dbd4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:40.823583 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6c806833-2726-4de3-b6b8-ed0c58f3dbd4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:40.824026 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6c806833-2726-4de3-b6b8-ed0c58f3dbd4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:40.824794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6c806833-2726-4de3-b6b8-ed0c58f3dbd4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:40.825379 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6c806833-2726-4de3-b6b8-ed0c58f3dbd4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:40.957720 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-6c806833-2726-4de3-b6b8-ed0c58f3dbd4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:40.965775 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-6c806833-2726-4de3-b6b8-ed0c58f3dbd4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.153245 Jun 27 15:50:40.966341 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 181/356] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:40 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:41.100994 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8cc22483-b342-42e9-93fb-a3f173f3597e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:41.101605 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8cc22483-b342-42e9-93fb-a3f173f3597e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:41.108232 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8cc22483-b342-42e9-93fb-a3f173f3597e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:41.108675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8cc22483-b342-42e9-93fb-a3f173f3597e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:41.109446 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8cc22483-b342-42e9-93fb-a3f173f3597e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:41.109910 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8cc22483-b342-42e9-93fb-a3f173f3597e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:41.251620 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8cc22483-b342-42e9-93fb-a3f173f3597e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:41.261355 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-8cc22483-b342-42e9-93fb-a3f173f3597e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1313 microversion: 2.1 time: 0.164217 Jun 27 15:50:41.261949 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 176/357] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:41 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:41.544539 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-2d4c1b55-03db-4b02-a4c3-b5075162b8ee tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:41.545148 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-2d4c1b55-03db-4b02-a4c3-b5075162b8ee tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:41.551757 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2d4c1b55-03db-4b02-a4c3-b5075162b8ee tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:41.552207 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2d4c1b55-03db-4b02-a4c3-b5075162b8ee tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:41.552972 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2d4c1b55-03db-4b02-a4c3-b5075162b8ee tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:41.553405 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2d4c1b55-03db-4b02-a4c3-b5075162b8ee tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:41.688344 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2d4c1b55-03db-4b02-a4c3-b5075162b8ee tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:41.696844 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-2d4c1b55-03db-4b02-a4c3-b5075162b8ee tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1369 microversion: 2.1 time: 0.156095 Jun 27 15:50:41.697412 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 182/358] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:41 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:41.960481 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-11188eb7-ba1e-463a-8042-29968e50995e req-cbd4ef65-da45-47f3-a30b-f4e05736ff2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1639393-7ae9-4f69-8a8d-abc1a3eb39f6", "name": "network-vif-plugged", "status": "completed", "tag": "68739089-04a5-41a8-a31e-72e08096b056"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:41.973793 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-11188eb7-ba1e-463a-8042-29968e50995e req-cbd4ef65-da45-47f3-a30b-f4e05736ff2b service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:41.974401 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-11188eb7-ba1e-463a-8042-29968e50995e req-cbd4ef65-da45-47f3-a30b-f4e05736ff2b service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:41.983587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-24ffc23f-cbc4-4b32-a7b8-4bd92918f92e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:41.984733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-24ffc23f-cbc4-4b32-a7b8-4bd92918f92e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:41.999733 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-11188eb7-ba1e-463a-8042-29968e50995e req-cbd4ef65-da45-47f3-a30b-f4e05736ff2b service nova] Creating event network-vif-plugged:68739089-04a5-41a8-a31e-72e08096b056 for instance e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 on hv-cinder-84780 Jun 27 15:50:42.000936 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-24ffc23f-cbc4-4b32-a7b8-4bd92918f92e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:42.001882 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-24ffc23f-cbc4-4b32-a7b8-4bd92918f92e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:42.005265 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-24ffc23f-cbc4-4b32-a7b8-4bd92918f92e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:42.007307 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-24ffc23f-cbc4-4b32-a7b8-4bd92918f92e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:42.007543 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-11188eb7-ba1e-463a-8042-29968e50995e req-cbd4ef65-da45-47f3-a30b-f4e05736ff2b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050539 Jun 27 15:50:42.008311 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 177/359] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:50:42.185119 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-24ffc23f-cbc4-4b32-a7b8-4bd92918f92e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:42.194134 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-24ffc23f-cbc4-4b32-a7b8-4bd92918f92e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.214187 Jun 27 15:50:42.194721 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 183/360] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:41 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:42.279647 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-12fd3317-a138-43f0-a052-a0e2d4208cd5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:42.280370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-12fd3317-a138-43f0-a052-a0e2d4208cd5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:42.288436 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-12fd3317-a138-43f0-a052-a0e2d4208cd5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:42.288890 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-12fd3317-a138-43f0-a052-a0e2d4208cd5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:42.289699 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-12fd3317-a138-43f0-a052-a0e2d4208cd5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:42.290143 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-12fd3317-a138-43f0-a052-a0e2d4208cd5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:42.423612 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=2 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:42.475632 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-12fd3317-a138-43f0-a052-a0e2d4208cd5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:42.483796 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-12fd3317-a138-43f0-a052-a0e2d4208cd5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1313 microversion: 2.1 time: 0.208237 Jun 27 15:50:42.484374 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 178/361] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:42 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:42.524477 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-203369a9-8250-4d94-930c-96de56a81c68 req-8fc2d2fc-0906-4853-b8eb-e59650cd553a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "936500ce-291e-420d-be24-d5a7919350f6", "tag": "df282c39-1e8b-43bd-9dde-0ce20496061e"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:42.534319 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-203369a9-8250-4d94-930c-96de56a81c68 req-8fc2d2fc-0906-4853-b8eb-e59650cd553a service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:42.535059 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-203369a9-8250-4d94-930c-96de56a81c68 req-8fc2d2fc-0906-4853-b8eb-e59650cd553a service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:42.553334 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-203369a9-8250-4d94-930c-96de56a81c68 req-8fc2d2fc-0906-4853-b8eb-e59650cd553a service nova] Creating event network-changed:df282c39-1e8b-43bd-9dde-0ce20496061e for instance 936500ce-291e-420d-be24-d5a7919350f6 on hv-cinder-84780 Jun 27 15:50:42.558736 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-203369a9-8250-4d94-930c-96de56a81c68 req-8fc2d2fc-0906-4853-b8eb-e59650cd553a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037863 Jun 27 15:50:42.559336 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 184/362] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:50:42.713187 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-cc7d4019-8d48-4509-a8bf-ce9b79552e01 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:42.713821 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-cc7d4019-8d48-4509-a8bf-ce9b79552e01 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:42.715643 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=8 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:42.722391 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cc7d4019-8d48-4509-a8bf-ce9b79552e01 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:42.722849 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cc7d4019-8d48-4509-a8bf-ce9b79552e01 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:42.723625 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cc7d4019-8d48-4509-a8bf-ce9b79552e01 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:42.724067 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cc7d4019-8d48-4509-a8bf-ce9b79552e01 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:42.859830 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-cc7d4019-8d48-4509-a8bf-ce9b79552e01 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:42.868101 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-cc7d4019-8d48-4509-a8bf-ce9b79552e01 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1369 microversion: 2.1 time: 0.158751 Jun 27 15:50:42.868751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 179/363] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:42 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:43.211420 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-41c4cf54-b5a5-4a86-9fd9-c8a4a8be34bc tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:43.212122 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-41c4cf54-b5a5-4a86-9fd9-c8a4a8be34bc tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:43.218655 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-41c4cf54-b5a5-4a86-9fd9-c8a4a8be34bc tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:43.219123 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-41c4cf54-b5a5-4a86-9fd9-c8a4a8be34bc tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:43.219905 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-41c4cf54-b5a5-4a86-9fd9-c8a4a8be34bc tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:43.220344 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-41c4cf54-b5a5-4a86-9fd9-c8a4a8be34bc tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:43.361155 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-41c4cf54-b5a5-4a86-9fd9-c8a4a8be34bc tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:43.370281 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-41c4cf54-b5a5-4a86-9fd9-c8a4a8be34bc tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.163514 Jun 27 15:50:43.370860 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 185/364] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:43 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:43.501152 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-b4bcfadb-63bf-42f5-be6f-05b09fc42294 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:43.501722 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-b4bcfadb-63bf-42f5-be6f-05b09fc42294 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:43.509459 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b4bcfadb-63bf-42f5-be6f-05b09fc42294 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:43.509942 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b4bcfadb-63bf-42f5-be6f-05b09fc42294 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:43.510717 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b4bcfadb-63bf-42f5-be6f-05b09fc42294 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:43.511148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b4bcfadb-63bf-42f5-be6f-05b09fc42294 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:43.646773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b4bcfadb-63bf-42f5-be6f-05b09fc42294 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:43.654191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-b4bcfadb-63bf-42f5-be6f-05b09fc42294 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1313 microversion: 2.1 time: 0.157229 Jun 27 15:50:43.654752 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 180/365] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:43 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:43.885499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-88a72043-0684-464e-9159-b823a74cb3fa tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:43.886144 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-88a72043-0684-464e-9159-b823a74cb3fa tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:43.892239 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-88a72043-0684-464e-9159-b823a74cb3fa tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:43.892867 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-88a72043-0684-464e-9159-b823a74cb3fa tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:43.894108 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-88a72043-0684-464e-9159-b823a74cb3fa tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:43.894545 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-88a72043-0684-464e-9159-b823a74cb3fa tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:44.025264 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-88a72043-0684-464e-9159-b823a74cb3fa tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:44.032745 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-88a72043-0684-464e-9159-b823a74cb3fa tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1369 microversion: 2.1 time: 0.151052 Jun 27 15:50:44.033609 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 186/366] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:43 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:44.388360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-42b5e3bc-cc62-45ac-956f-588289bd2a1a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:44.388911 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-42b5e3bc-cc62-45ac-956f-588289bd2a1a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:44.395225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-42b5e3bc-cc62-45ac-956f-588289bd2a1a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:44.395667 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-42b5e3bc-cc62-45ac-956f-588289bd2a1a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:44.396423 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-42b5e3bc-cc62-45ac-956f-588289bd2a1a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:44.396874 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-42b5e3bc-cc62-45ac-956f-588289bd2a1a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:44.400894 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=100 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:44.537144 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-42b5e3bc-cc62-45ac-956f-588289bd2a1a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:44.547433 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-42b5e3bc-cc62-45ac-956f-588289bd2a1a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.162933 Jun 27 15:50:44.548104 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 181/367] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:44 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:44.670433 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-2250014d-9b40-4023-a03f-e118a86a6203 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:44.671043 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-2250014d-9b40-4023-a03f-e118a86a6203 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:44.678795 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2250014d-9b40-4023-a03f-e118a86a6203 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:44.679289 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2250014d-9b40-4023-a03f-e118a86a6203 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:44.680014 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2250014d-9b40-4023-a03f-e118a86a6203 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:44.680449 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2250014d-9b40-4023-a03f-e118a86a6203 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:44.831651 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2250014d-9b40-4023-a03f-e118a86a6203 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:44.839224 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-2250014d-9b40-4023-a03f-e118a86a6203 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1313 microversion: 2.1 time: 0.172697 Jun 27 15:50:44.839845 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 187/368] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:44 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:45.051081 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8017e49c-8ae3-43a2-bf63-eab78f5f61a1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:45.051701 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8017e49c-8ae3-43a2-bf63-eab78f5f61a1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:45.058520 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8017e49c-8ae3-43a2-bf63-eab78f5f61a1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:45.058971 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8017e49c-8ae3-43a2-bf63-eab78f5f61a1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:45.059738 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8017e49c-8ae3-43a2-bf63-eab78f5f61a1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:45.060174 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8017e49c-8ae3-43a2-bf63-eab78f5f61a1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:45.198704 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8017e49c-8ae3-43a2-bf63-eab78f5f61a1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:45.206184 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-8017e49c-8ae3-43a2-bf63-eab78f5f61a1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1369 microversion: 2.1 time: 0.159940 Jun 27 15:50:45.206749 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 182/369] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:45 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:45.565109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-cae59df8-9608-4b23-99d4-c164216be317 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:45.565763 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-cae59df8-9608-4b23-99d4-c164216be317 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:45.585449 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cae59df8-9608-4b23-99d4-c164216be317 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:45.585970 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cae59df8-9608-4b23-99d4-c164216be317 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:45.586769 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cae59df8-9608-4b23-99d4-c164216be317 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:45.587309 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cae59df8-9608-4b23-99d4-c164216be317 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:45.715683 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-258464c8-5a61-4277-8e49-94fbfe92a011 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1107870895", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-121267945", "security_groups": [{"name": "tempest-secgroup-smoke-630239606"}], "block_device_mapping_v2": [{"uuid": "a29a947b-0d2f-4cd7-98aa-b695c7f3cb36", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "baf48a70-9fcf-4c95-9a4f-c0f2d3f641eb"}]}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:45.733050 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-cae59df8-9608-4b23-99d4-c164216be317 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:45.742490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-cae59df8-9608-4b23-99d4-c164216be317 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.181691 Jun 27 15:50:45.742986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 188/370] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:45 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:45.835445 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.network.neutron [None req-258464c8-5a61-4277-8e49-94fbfe92a011 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] validate_networks() for [('baf48a70-9fcf-4c95-9a4f-c0f2d3f641eb', None, None, None, None, None)] {{(pid=129472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:50:45.855952 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f0e77ecb-010c-41c7-9a67-9fdc0ad5766b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:45.856658 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f0e77ecb-010c-41c7-9a67-9fdc0ad5766b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:45.863803 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f0e77ecb-010c-41c7-9a67-9fdc0ad5766b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:45.864261 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f0e77ecb-010c-41c7-9a67-9fdc0ad5766b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:45.865346 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f0e77ecb-010c-41c7-9a67-9fdc0ad5766b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:45.865818 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f0e77ecb-010c-41c7-9a67-9fdc0ad5766b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:46.071360 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f0e77ecb-010c-41c7-9a67-9fdc0ad5766b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:46.079262 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f0e77ecb-010c-41c7-9a67-9fdc0ad5766b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1497 microversion: 2.1 time: 0.227072 Jun 27 15:50:46.079856 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 189/371] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:45 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1497 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:46.226153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-be99980b-011f-4d97-8af8-6b72e5e3ee8e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:46.226764 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-be99980b-011f-4d97-8af8-6b72e5e3ee8e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:46.233007 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-be99980b-011f-4d97-8af8-6b72e5e3ee8e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:46.233405 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-be99980b-011f-4d97-8af8-6b72e5e3ee8e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:46.234262 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-be99980b-011f-4d97-8af8-6b72e5e3ee8e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:46.234699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-be99980b-011f-4d97-8af8-6b72e5e3ee8e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:46.319629 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-258464c8-5a61-4277-8e49-94fbfe92a011 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Flavor limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:50:46.319779 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-258464c8-5a61-4277-8e49-94fbfe92a011 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Image limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:50:46.320257 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-258464c8-5a61-4277-8e49-94fbfe92a011 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Flavor pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:50:46.322063 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-258464c8-5a61-4277-8e49-94fbfe92a011 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Image pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:50:46.322063 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-258464c8-5a61-4277-8e49-94fbfe92a011 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:50:46.333209 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-258464c8-5a61-4277-8e49-94fbfe92a011 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:46.333608 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-258464c8-5a61-4277-8e49-94fbfe92a011 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:46.334569 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-258464c8-5a61-4277-8e49-94fbfe92a011 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:46.335211 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-258464c8-5a61-4277-8e49-94fbfe92a011 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:46.367494 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-258464c8-5a61-4277-8e49-94fbfe92a011 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Getting quotas for project ec9f767e3b4d4fb78f86a611ed9f47c5. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:50:46.373230 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-258464c8-5a61-4277-8e49-94fbfe92a011 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Getting quotas for user 25024a505319480ab00f4c7e58de600c and project ec9f767e3b4d4fb78f86a611ed9f47c5. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:50:46.414581 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-be99980b-011f-4d97-8af8-6b72e5e3ee8e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:46.417721 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-be99980b-011f-4d97-8af8-6b72e5e3ee8e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1369 microversion: 2.1 time: 0.196786 Jun 27 15:50:46.418484 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 190/372] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:46 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1369 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:46.447319 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-258464c8-5a61-4277-8e49-94fbfe92a011 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Going to run 1 instances... {{(pid=129472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:50:46.449622 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-258464c8-5a61-4277-8e49-94fbfe92a011 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a29a947b-0d2f-4cd7-98aa-b695c7f3cb36',volume_size=None,volume_type=None)] {{(pid=129472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:50:46.599983 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-258464c8-5a61-4277-8e49-94fbfe92a011 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.887624 Jun 27 15:50:46.600794 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 183/373] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 15:50:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 15:50:46.611207 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-98f8b442-d4a8-430d-9937-9e1273fe46e3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:46.611831 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-98f8b442-d4a8-430d-9937-9e1273fe46e3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:46.666226 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-98f8b442-d4a8-430d-9937-9e1273fe46e3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:46.673340 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-98f8b442-d4a8-430d-9937-9e1273fe46e3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1094 microversion: 2.1 time: 0.066108 Jun 27 15:50:46.675144 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 191/374] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:46 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:46.761323 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8f4adcd8-2ea5-4dfa-b50e-379f8c36e8e9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:46.762042 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8f4adcd8-2ea5-4dfa-b50e-379f8c36e8e9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:46.771755 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8f4adcd8-2ea5-4dfa-b50e-379f8c36e8e9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:46.772323 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8f4adcd8-2ea5-4dfa-b50e-379f8c36e8e9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:46.773432 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8f4adcd8-2ea5-4dfa-b50e-379f8c36e8e9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:46.774364 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8f4adcd8-2ea5-4dfa-b50e-379f8c36e8e9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:46.949953 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a9173a1c-d04d-4695-8402-cf5b7b7aa509 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:46.951344 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a9173a1c-d04d-4695-8402-cf5b7b7aa509 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:46.953154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8f4adcd8-2ea5-4dfa-b50e-379f8c36e8e9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:46.960165 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a9173a1c-d04d-4695-8402-cf5b7b7aa509 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:46.960817 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a9173a1c-d04d-4695-8402-cf5b7b7aa509 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:46.961897 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a9173a1c-d04d-4695-8402-cf5b7b7aa509 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:46.962597 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a9173a1c-d04d-4695-8402-cf5b7b7aa509 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:46.964313 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-8f4adcd8-2ea5-4dfa-b50e-379f8c36e8e9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.208539 Jun 27 15:50:46.965480 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 184/375] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:46 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:46.992526 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a9173a1c-d04d-4695-8402-cf5b7b7aa509 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Going to try to terminate instance {{(pid=129473) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:50:47.087473 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a9173a1c-d04d-4695-8402-cf5b7b7aa509 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 204 len: 0 microversion: 2.1 time: 0.142534 Jun 27 15:50:47.088168 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 192/376] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:50:46 2022] DELETE /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:50:47.097523 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-79d56c3c-658e-4110-a9b8-8eaba23c16ce tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:47.098159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-79d56c3c-658e-4110-a9b8-8eaba23c16ce tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:47.104529 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-79d56c3c-658e-4110-a9b8-8eaba23c16ce tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:47.104955 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-79d56c3c-658e-4110-a9b8-8eaba23c16ce tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:47.105760 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-79d56c3c-658e-4110-a9b8-8eaba23c16ce tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:47.106194 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-79d56c3c-658e-4110-a9b8-8eaba23c16ce tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:47.249181 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-79d56c3c-658e-4110-a9b8-8eaba23c16ce tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:47.257339 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-79d56c3c-658e-4110-a9b8-8eaba23c16ce tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1503 microversion: 2.1 time: 0.164470 Jun 27 15:50:47.258149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 185/377] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:47 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:47.436908 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-01230cd7-bef5-4706-8fca-64fb61e71fec tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:47.437517 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-01230cd7-bef5-4706-8fca-64fb61e71fec tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:47.444276 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-01230cd7-bef5-4706-8fca-64fb61e71fec tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:47.444731 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-01230cd7-bef5-4706-8fca-64fb61e71fec tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:47.445501 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-01230cd7-bef5-4706-8fca-64fb61e71fec tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:47.446001 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-01230cd7-bef5-4706-8fca-64fb61e71fec tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:47.500920 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f8340c16-ef17-42e3-9899-a21061aae14f tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:47.501503 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f8340c16-ef17-42e3-9899-a21061aae14f tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:47.512096 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f8340c16-ef17-42e3-9899-a21061aae14f tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:47.512791 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f8340c16-ef17-42e3-9899-a21061aae14f tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:47.513325 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f8340c16-ef17-42e3-9899-a21061aae14f tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:47.513828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f8340c16-ef17-42e3-9899-a21061aae14f tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:47.583751 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-01230cd7-bef5-4706-8fca-64fb61e71fec tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:47.591817 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-01230cd7-bef5-4706-8fca-64fb61e71fec tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1369 microversion: 2.1 time: 0.159077 Jun 27 15:50:47.592388 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 193/378] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:47 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:47.643476 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-f8340c16-ef17-42e3-9899-a21061aae14f tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lazy-loading 'services' on Instance uuid d49d4234-4e82-48ef-985d-fa848a6856f7 {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:50:47.691925 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-11ffbde2-a32e-4761-8d3a-8da5a984ea4a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:47.692500 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-11ffbde2-a32e-4761-8d3a-8da5a984ea4a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:47.699154 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-11ffbde2-a32e-4761-8d3a-8da5a984ea4a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:47.699609 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-11ffbde2-a32e-4761-8d3a-8da5a984ea4a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:47.700390 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-11ffbde2-a32e-4761-8d3a-8da5a984ea4a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:47.700851 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-11ffbde2-a32e-4761-8d3a-8da5a984ea4a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:47.761157 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f8340c16-ef17-42e3-9899-a21061aae14f tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7/os-volume_attachments/864085aa-6547-4052-9075-a7fe78d453ec" status: 202 len: 0 microversion: 2.1 time: 0.263977 Jun 27 15:50:47.761769 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 186/379] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 27 15:50:47 2022] DELETE /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7/os-volume_attachments/864085aa-6547-4052-9075-a7fe78d453ec => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:50:47.772800 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-11ffbde2-a32e-4761-8d3a-8da5a984ea4a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:47.781183 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-11ffbde2-a32e-4761-8d3a-8da5a984ea4a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1144 microversion: 2.1 time: 0.093682 Jun 27 15:50:47.781863 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 194/380] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:47 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:47.984178 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3a0acd30-fd11-4fc1-8e1c-441e51fc0b8f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:47.984796 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3a0acd30-fd11-4fc1-8e1c-441e51fc0b8f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:47.992290 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3a0acd30-fd11-4fc1-8e1c-441e51fc0b8f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:47.992739 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3a0acd30-fd11-4fc1-8e1c-441e51fc0b8f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:47.993506 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3a0acd30-fd11-4fc1-8e1c-441e51fc0b8f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:47.993975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3a0acd30-fd11-4fc1-8e1c-441e51fc0b8f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:48.131038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3a0acd30-fd11-4fc1-8e1c-441e51fc0b8f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:48.142322 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3a0acd30-fd11-4fc1-8e1c-441e51fc0b8f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1724 microversion: 2.1 time: 0.162408 Jun 27 15:50:48.143070 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 187/381] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:47 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:48.274650 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-6bb277a5-bfde-460d-977b-c71222bebf9d tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:48.275252 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-6bb277a5-bfde-460d-977b-c71222bebf9d tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:48.281212 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6bb277a5-bfde-460d-977b-c71222bebf9d tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:48.281775 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6bb277a5-bfde-460d-977b-c71222bebf9d tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:48.282527 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6bb277a5-bfde-460d-977b-c71222bebf9d tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:48.282951 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6bb277a5-bfde-460d-977b-c71222bebf9d tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:48.415018 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-6bb277a5-bfde-460d-977b-c71222bebf9d tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:48.422725 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-6bb277a5-bfde-460d-977b-c71222bebf9d tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1503 microversion: 2.1 time: 0.151849 Jun 27 15:50:48.423370 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 195/382] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:48 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:48.608433 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d7433621-7e59-412f-937e-01e16cbd11d4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:48.609027 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d7433621-7e59-412f-937e-01e16cbd11d4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:48.615611 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d7433621-7e59-412f-937e-01e16cbd11d4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:48.616050 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d7433621-7e59-412f-937e-01e16cbd11d4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:48.616804 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d7433621-7e59-412f-937e-01e16cbd11d4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:48.617226 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d7433621-7e59-412f-937e-01e16cbd11d4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:48.771678 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d7433621-7e59-412f-937e-01e16cbd11d4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:48.779487 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d7433621-7e59-412f-937e-01e16cbd11d4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1369 microversion: 2.1 time: 0.174869 Jun 27 15:50:48.789829 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 188/383] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:48 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1369 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:48.799305 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e5033298-83fd-4525-8a8c-71604b913d34 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:48.800249 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e5033298-83fd-4525-8a8c-71604b913d34 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:48.807603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e5033298-83fd-4525-8a8c-71604b913d34 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:48.808128 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e5033298-83fd-4525-8a8c-71604b913d34 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:48.809558 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e5033298-83fd-4525-8a8c-71604b913d34 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:48.810092 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e5033298-83fd-4525-8a8c-71604b913d34 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:48.815131 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:48.878899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e5033298-83fd-4525-8a8c-71604b913d34 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:48.887135 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e5033298-83fd-4525-8a8c-71604b913d34 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1136 microversion: 2.1 time: 0.092277 Jun 27 15:50:48.887718 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 196/384] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:48 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1136 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:49.166545 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-6140a14c-7597-40d9-91d4-d12aca67b9d0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:49.170845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-6140a14c-7597-40d9-91d4-d12aca67b9d0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:49.183748 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6140a14c-7597-40d9-91d4-d12aca67b9d0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:49.184541 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6140a14c-7597-40d9-91d4-d12aca67b9d0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:49.187300 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6140a14c-7597-40d9-91d4-d12aca67b9d0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:49.188356 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6140a14c-7597-40d9-91d4-d12aca67b9d0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:49.338462 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-6140a14c-7597-40d9-91d4-d12aca67b9d0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:49.346508 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-6140a14c-7597-40d9-91d4-d12aca67b9d0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1701 microversion: 2.1 time: 0.189615 Jun 27 15:50:49.347064 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 189/385] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:49 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1701 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:49.363242 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-6f944166-30e2-49d7-abd4-dfb79f69a212 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:49.369602 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6f944166-30e2-49d7-abd4-dfb79f69a212 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:49.370077 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6f944166-30e2-49d7-abd4-dfb79f69a212 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:49.393468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-6f944166-30e2-49d7-abd4-dfb79f69a212 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Going to try to start instance {{(pid=129473) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 27 15:50:49.434061 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-6f944166-30e2-49d7-abd4-dfb79f69a212 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "POST /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb/action" status: 202 len: 0 microversion: 2.1 time: 0.075170 Jun 27 15:50:49.434655 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 197/386] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 27 15:50:49 2022] POST /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:50:49.441117 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d4d8fb19-4df9-4fec-bc21-bcaaef16f50a tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:49.441853 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d4d8fb19-4df9-4fec-bc21-bcaaef16f50a tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:49.443472 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-60fa82d2-edaa-4a05-99bc-78f40512fe28 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:49.444006 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-60fa82d2-edaa-4a05-99bc-78f40512fe28 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:49.447907 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d4d8fb19-4df9-4fec-bc21-bcaaef16f50a tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:49.448351 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d4d8fb19-4df9-4fec-bc21-bcaaef16f50a tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:49.449113 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d4d8fb19-4df9-4fec-bc21-bcaaef16f50a tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:49.449575 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d4d8fb19-4df9-4fec-bc21-bcaaef16f50a tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:49.450128 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-60fa82d2-edaa-4a05-99bc-78f40512fe28 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:49.450573 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-60fa82d2-edaa-4a05-99bc-78f40512fe28 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:49.451323 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-60fa82d2-edaa-4a05-99bc-78f40512fe28 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:49.451753 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-60fa82d2-edaa-4a05-99bc-78f40512fe28 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:49.636522 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d4d8fb19-4df9-4fec-bc21-bcaaef16f50a tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:49.644911 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d4d8fb19-4df9-4fec-bc21-bcaaef16f50a tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1503 microversion: 2.1 time: 0.208226 Jun 27 15:50:49.645608 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 190/387] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:49 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:49.650175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-60fa82d2-edaa-4a05-99bc-78f40512fe28 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:49.658312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-60fa82d2-edaa-4a05-99bc-78f40512fe28 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1710 microversion: 2.1 time: 0.219414 Jun 27 15:50:49.660111 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 198/388] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:49 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1710 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:49.797497 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-1a4676b2-aac1-4a77-8a85-b4aec0d11c78 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:49.798290 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-1a4676b2-aac1-4a77-8a85-b4aec0d11c78 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:49.805076 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1a4676b2-aac1-4a77-8a85-b4aec0d11c78 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:49.805526 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1a4676b2-aac1-4a77-8a85-b4aec0d11c78 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:49.806323 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1a4676b2-aac1-4a77-8a85-b4aec0d11c78 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:49.806762 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1a4676b2-aac1-4a77-8a85-b4aec0d11c78 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:49.904498 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c7d18bec-95d3-421e-a45b-460938902a2c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:49.907960 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c7d18bec-95d3-421e-a45b-460938902a2c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:49.922719 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c7d18bec-95d3-421e-a45b-460938902a2c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:49.923173 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c7d18bec-95d3-421e-a45b-460938902a2c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:49.924191 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c7d18bec-95d3-421e-a45b-460938902a2c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:49.924840 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c7d18bec-95d3-421e-a45b-460938902a2c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:49.964502 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-1a4676b2-aac1-4a77-8a85-b4aec0d11c78 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:49.974807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-1a4676b2-aac1-4a77-8a85-b4aec0d11c78 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1369 microversion: 2.1 time: 0.180963 Jun 27 15:50:49.975920 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 191/389] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:49 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1369 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:50.046572 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-c7d18bec-95d3-421e-a45b-460938902a2c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:50.063275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c7d18bec-95d3-421e-a45b-460938902a2c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1192 microversion: 2.1 time: 0.162479 Jun 27 15:50:50.065581 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 199/390] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:49 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1192 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:50.250114 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-fe291848-9eff-4236-ae84-ce5f31e391d6 req-f1009c84-22b4-4b61-9d0e-1dd2440cd23d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936500ce-291e-420d-be24-d5a7919350f6", "name": "network-vif-plugged", "status": "completed", "tag": "df282c39-1e8b-43bd-9dde-0ce20496061e"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:50.273062 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-fe291848-9eff-4236-ae84-ce5f31e391d6 req-f1009c84-22b4-4b61-9d0e-1dd2440cd23d service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:50.273675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-fe291848-9eff-4236-ae84-ce5f31e391d6 req-f1009c84-22b4-4b61-9d0e-1dd2440cd23d service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:50.294616 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-fe291848-9eff-4236-ae84-ce5f31e391d6 req-f1009c84-22b4-4b61-9d0e-1dd2440cd23d service nova] Creating event network-vif-plugged:df282c39-1e8b-43bd-9dde-0ce20496061e for instance 936500ce-291e-420d-be24-d5a7919350f6 on hv-cinder-84780 Jun 27 15:50:50.313607 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-fe291848-9eff-4236-ae84-ce5f31e391d6 req-f1009c84-22b4-4b61-9d0e-1dd2440cd23d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076483 Jun 27 15:50:50.316435 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 192/391] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:50:50.673486 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-47a5d584-7649-40e0-8bb0-b2cc812e06c3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:50.675448 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-47a5d584-7649-40e0-8bb0-b2cc812e06c3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:50.677293 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-0ab5eb81-dcb4-4438-b4c0-72b94bc889ef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:50.678126 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-0ab5eb81-dcb4-4438-b4c0-72b94bc889ef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:50.682215 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-47a5d584-7649-40e0-8bb0-b2cc812e06c3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:50.683108 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-47a5d584-7649-40e0-8bb0-b2cc812e06c3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:50.684060 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-47a5d584-7649-40e0-8bb0-b2cc812e06c3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:50.684714 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-47a5d584-7649-40e0-8bb0-b2cc812e06c3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:50.689690 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0ab5eb81-dcb4-4438-b4c0-72b94bc889ef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:50.695448 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0ab5eb81-dcb4-4438-b4c0-72b94bc889ef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:50.696281 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0ab5eb81-dcb4-4438-b4c0-72b94bc889ef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:50.702197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0ab5eb81-dcb4-4438-b4c0-72b94bc889ef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:50.979636 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-47a5d584-7649-40e0-8bb0-b2cc812e06c3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:50.990091 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-47a5d584-7649-40e0-8bb0-b2cc812e06c3 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1503 microversion: 2.1 time: 0.328593 Jun 27 15:50:50.990951 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 200/392] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:50 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1503 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:50.998821 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-b9d5e79f-cc91-46db-a5b5-fa008f9d132d req-3b8f5b4c-8f8f-415b-9b60-eeb6a3f7535d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1639393-7ae9-4f69-8a8d-abc1a3eb39f6", "name": "network-vif-deleted", "tag": "68739089-04a5-41a8-a31e-72e08096b056"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:51.003424 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:51.011234 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-b9d5e79f-cc91-46db-a5b5-fa008f9d132d req-3b8f5b4c-8f8f-415b-9b60-eeb6a3f7535d service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:51.011747 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-b9d5e79f-cc91-46db-a5b5-fa008f9d132d req-3b8f5b4c-8f8f-415b-9b60-eeb6a3f7535d service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:51.026345 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-b9d5e79f-cc91-46db-a5b5-fa008f9d132d req-3b8f5b4c-8f8f-415b-9b60-eeb6a3f7535d service nova] Creating event network-vif-deleted:68739089-04a5-41a8-a31e-72e08096b056 for instance e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 on hv-cinder-84780 Jun 27 15:50:51.031298 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-b9d5e79f-cc91-46db-a5b5-fa008f9d132d req-3b8f5b4c-8f8f-415b-9b60-eeb6a3f7535d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039032 Jun 27 15:50:51.031979 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 201/393] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:50:51.037531 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-09cb3a01-1c9f-4764-8a35-07bdf3615a1b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:51.038329 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-09cb3a01-1c9f-4764-8a35-07bdf3615a1b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:51.038575 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0ab5eb81-dcb4-4438-b4c0-72b94bc889ef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:51.044998 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-09cb3a01-1c9f-4764-8a35-07bdf3615a1b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:51.045765 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-09cb3a01-1c9f-4764-8a35-07bdf3615a1b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:51.046800 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-09cb3a01-1c9f-4764-8a35-07bdf3615a1b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:51.047232 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-09cb3a01-1c9f-4764-8a35-07bdf3615a1b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:51.050884 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-0ab5eb81-dcb4-4438-b4c0-72b94bc889ef tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1710 microversion: 2.1 time: 0.378499 Jun 27 15:50:51.052034 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 193/394] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:50 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1710 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:51.057715 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a8b1751e-3c47-4e8d-8509-d625c7b9a19c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:51.059109 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a8b1751e-3c47-4e8d-8509-d625c7b9a19c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:51.066492 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:51.068705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a8b1751e-3c47-4e8d-8509-d625c7b9a19c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:51.069326 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a8b1751e-3c47-4e8d-8509-d625c7b9a19c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:51.071130 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a8b1751e-3c47-4e8d-8509-d625c7b9a19c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:51.071738 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a8b1751e-3c47-4e8d-8509-d625c7b9a19c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:51.112122 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a8b1751e-3c47-4e8d-8509-d625c7b9a19c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Going to try to terminate instance {{(pid=129472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:50:51.203905 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-a8b1751e-3c47-4e8d-8509-d625c7b9a19c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 204 len: 0 microversion: 2.1 time: 0.149081 Jun 27 15:50:51.208241 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 194/395] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:50:51 2022] DELETE /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:50:51.216473 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-46a122bf-485a-44f6-bb9a-38d0af794bf6 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:51.217789 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-46a122bf-485a-44f6-bb9a-38d0af794bf6 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:51.229708 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-46a122bf-485a-44f6-bb9a-38d0af794bf6 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:51.230622 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-46a122bf-485a-44f6-bb9a-38d0af794bf6 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:51.231915 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-46a122bf-485a-44f6-bb9a-38d0af794bf6 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:51.232684 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-46a122bf-485a-44f6-bb9a-38d0af794bf6 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:51.347110 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-46a122bf-485a-44f6-bb9a-38d0af794bf6 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:51.354665 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-46a122bf-485a-44f6-bb9a-38d0af794bf6 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1210 microversion: 2.1 time: 0.147975 Jun 27 15:50:51.355248 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 195/396] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:51 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1210 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:51.364125 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-faad691d-608c-4657-9087-117eebc865cb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:51.364125 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-faad691d-608c-4657-9087-117eebc865cb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:51.364603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-09cb3a01-1c9f-4764-8a35-07bdf3615a1b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:51.369325 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-faad691d-608c-4657-9087-117eebc865cb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:51.369954 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-faad691d-608c-4657-9087-117eebc865cb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:51.370606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-faad691d-608c-4657-9087-117eebc865cb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:51.371085 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-faad691d-608c-4657-9087-117eebc865cb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:51.372966 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-09cb3a01-1c9f-4764-8a35-07bdf3615a1b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1369 microversion: 2.1 time: 0.339356 Jun 27 15:50:51.375368 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 202/397] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:51 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1369 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:51.606258 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-faad691d-608c-4657-9087-117eebc865cb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:51.610031 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:51.616580 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-faad691d-608c-4657-9087-117eebc865cb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1513 microversion: 2.1 time: 0.259962 Jun 27 15:50:51.617170 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 196/398] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:51 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1513 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:52.007435 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-01d34935-4097-4bd9-b4a8-24dec06e8bf1 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:52.007984 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-01d34935-4097-4bd9-b4a8-24dec06e8bf1 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:52.014773 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-01d34935-4097-4bd9-b4a8-24dec06e8bf1 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:52.015230 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-01d34935-4097-4bd9-b4a8-24dec06e8bf1 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:52.016137 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-01d34935-4097-4bd9-b4a8-24dec06e8bf1 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:52.016579 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-01d34935-4097-4bd9-b4a8-24dec06e8bf1 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:52.068519 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-834814ea-4057-4ca9-89e0-40ea391f6bc6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:52.069134 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-834814ea-4057-4ca9-89e0-40ea391f6bc6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:52.076824 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-834814ea-4057-4ca9-89e0-40ea391f6bc6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:52.077273 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-834814ea-4057-4ca9-89e0-40ea391f6bc6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:52.078069 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-834814ea-4057-4ca9-89e0-40ea391f6bc6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:52.078506 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-834814ea-4057-4ca9-89e0-40ea391f6bc6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:52.088001 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-01d34935-4097-4bd9-b4a8-24dec06e8bf1 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:52.096172 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-01d34935-4097-4bd9-b4a8-24dec06e8bf1 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1298 microversion: 2.1 time: 0.092043 Jun 27 15:50:52.096826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 203/399] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:52 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:52.212593 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-834814ea-4057-4ca9-89e0-40ea391f6bc6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:52.220603 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-834814ea-4057-4ca9-89e0-40ea391f6bc6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1710 microversion: 2.1 time: 0.156313 Jun 27 15:50:52.222087 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 197/400] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:52 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1710 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:52.372971 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-fee7ad45-681c-45e0-a902-e849f1cedfff tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:52.373579 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-fee7ad45-681c-45e0-a902-e849f1cedfff tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:52.380184 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fee7ad45-681c-45e0-a902-e849f1cedfff tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:52.380628 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fee7ad45-681c-45e0-a902-e849f1cedfff tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:52.381418 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fee7ad45-681c-45e0-a902-e849f1cedfff tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:52.381884 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fee7ad45-681c-45e0-a902-e849f1cedfff tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:52.390348 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-0cf46709-af4a-4f6d-8c16-237586aec055 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:52.390983 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-0cf46709-af4a-4f6d-8c16-237586aec055 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:52.397194 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0cf46709-af4a-4f6d-8c16-237586aec055 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:52.397657 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0cf46709-af4a-4f6d-8c16-237586aec055 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:52.398437 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0cf46709-af4a-4f6d-8c16-237586aec055 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:52.398868 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0cf46709-af4a-4f6d-8c16-237586aec055 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:52.831470 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-fee7ad45-681c-45e0-a902-e849f1cedfff tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:52.839275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-fee7ad45-681c-45e0-a902-e849f1cedfff tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1277 microversion: 2.1 time: 0.470078 Jun 27 15:50:52.839855 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 204/401] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:52 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1277 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:52.844466 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-483a99d2-8cbe-4f44-a3e6-03e7061ef3cb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:52.845075 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-483a99d2-8cbe-4f44-a3e6-03e7061ef3cb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:52.850526 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0cf46709-af4a-4f6d-8c16-237586aec055 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:52.851431 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-483a99d2-8cbe-4f44-a3e6-03e7061ef3cb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:52.851881 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-483a99d2-8cbe-4f44-a3e6-03e7061ef3cb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:52.852662 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-483a99d2-8cbe-4f44-a3e6-03e7061ef3cb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:52.853100 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-483a99d2-8cbe-4f44-a3e6-03e7061ef3cb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:52.858233 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-0cf46709-af4a-4f6d-8c16-237586aec055 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1369 microversion: 2.1 time: 0.471635 Jun 27 15:50:52.858809 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 198/402] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:52 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1369 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:52.986736 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-483a99d2-8cbe-4f44-a3e6-03e7061ef3cb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:52.994872 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-483a99d2-8cbe-4f44-a3e6-03e7061ef3cb tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1513 microversion: 2.1 time: 0.153958 Jun 27 15:50:52.995399 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 205/403] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:52 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:53.114460 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c80cd2bb-75b1-4eba-8844-d6267cfa4a86 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:53.115112 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c80cd2bb-75b1-4eba-8844-d6267cfa4a86 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:53.131178 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c80cd2bb-75b1-4eba-8844-d6267cfa4a86 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:53.131624 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c80cd2bb-75b1-4eba-8844-d6267cfa4a86 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:53.132539 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c80cd2bb-75b1-4eba-8844-d6267cfa4a86 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:53.132853 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c80cd2bb-75b1-4eba-8844-d6267cfa4a86 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:53.219926 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-c80cd2bb-75b1-4eba-8844-d6267cfa4a86 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:53.229809 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c80cd2bb-75b1-4eba-8844-d6267cfa4a86 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1298 microversion: 2.1 time: 0.120188 Jun 27 15:50:53.230879 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 199/404] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:53 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1298 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:53.244286 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-65c1c081-bd43-4a48-8d6e-6ac2bf417aba tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:53.244927 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-65c1c081-bd43-4a48-8d6e-6ac2bf417aba tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:53.251856 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-65c1c081-bd43-4a48-8d6e-6ac2bf417aba tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:53.252707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-65c1c081-bd43-4a48-8d6e-6ac2bf417aba tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:53.253194 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-65c1c081-bd43-4a48-8d6e-6ac2bf417aba tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:53.253644 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-65c1c081-bd43-4a48-8d6e-6ac2bf417aba tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:53.510766 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-65c1c081-bd43-4a48-8d6e-6ac2bf417aba tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:53.519577 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-65c1c081-bd43-4a48-8d6e-6ac2bf417aba tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1710 microversion: 2.1 time: 0.284973 Jun 27 15:50:53.520329 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 206/405] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:53 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1710 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:53.857459 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-548209c9-64c4-4959-8f92-6523ec71860a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:53.859036 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-548209c9-64c4-4959-8f92-6523ec71860a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:53.868780 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-548209c9-64c4-4959-8f92-6523ec71860a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:53.869423 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-548209c9-64c4-4959-8f92-6523ec71860a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:53.870696 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-548209c9-64c4-4959-8f92-6523ec71860a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:53.871130 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-548209c9-64c4-4959-8f92-6523ec71860a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:53.875170 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-5c6c7a4f-1031-4688-a471-154cdc4af5dd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:53.876115 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-5c6c7a4f-1031-4688-a471-154cdc4af5dd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:53.887886 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5c6c7a4f-1031-4688-a471-154cdc4af5dd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:53.888816 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5c6c7a4f-1031-4688-a471-154cdc4af5dd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:53.890382 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5c6c7a4f-1031-4688-a471-154cdc4af5dd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:53.891036 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5c6c7a4f-1031-4688-a471-154cdc4af5dd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:54.227531 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-548209c9-64c4-4959-8f92-6523ec71860a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:54.235772 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-548209c9-64c4-4959-8f92-6523ec71860a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1277 microversion: 2.1 time: 0.382475 Jun 27 15:50:54.239092 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 200/406] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:53 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1277 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:54.244389 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-9060a413-f441-4698-9a50-80160e5f96a6 req-2c6d7e7b-33ee-4dd3-9ef8-854dfe0da237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a90fed-157b-47f0-bd62-401e29342025", "tag": "7f8f5cac-5782-481c-b444-127b88873db3"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:54.253242 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-9060a413-f441-4698-9a50-80160e5f96a6 req-2c6d7e7b-33ee-4dd3-9ef8-854dfe0da237 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:54.253969 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-9060a413-f441-4698-9a50-80160e5f96a6 req-2c6d7e7b-33ee-4dd3-9ef8-854dfe0da237 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:54.260335 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-5c6c7a4f-1031-4688-a471-154cdc4af5dd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:54.265958 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-9060a413-f441-4698-9a50-80160e5f96a6 req-2c6d7e7b-33ee-4dd3-9ef8-854dfe0da237 service nova] Creating event network-changed:7f8f5cac-5782-481c-b444-127b88873db3 for instance b6a90fed-157b-47f0-bd62-401e29342025 on hv-cinder-84780 Jun 27 15:50:54.268338 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-5c6c7a4f-1031-4688-a471-154cdc4af5dd tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1369 microversion: 2.1 time: 0.397335 Jun 27 15:50:54.269049 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 207/407] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:53 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1369 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:54.271703 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-9060a413-f441-4698-9a50-80160e5f96a6 req-2c6d7e7b-33ee-4dd3-9ef8-854dfe0da237 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031295 Jun 27 15:50:54.272292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 201/408] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:50:54.276191 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-eba82c1f-2d35-445c-bb9a-2c19b7778f68 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:54.276861 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-eba82c1f-2d35-445c-bb9a-2c19b7778f68 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:54.278167 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-bf1d076a-de21-4937-a801-7fc6b88ac700 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:54.278882 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-bf1d076a-de21-4937-a801-7fc6b88ac700 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:54.283745 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eba82c1f-2d35-445c-bb9a-2c19b7778f68 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:54.284189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eba82c1f-2d35-445c-bb9a-2c19b7778f68 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:54.284946 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eba82c1f-2d35-445c-bb9a-2c19b7778f68 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:54.285371 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eba82c1f-2d35-445c-bb9a-2c19b7778f68 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:54.286092 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bf1d076a-de21-4937-a801-7fc6b88ac700 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:54.286568 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bf1d076a-de21-4937-a801-7fc6b88ac700 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:54.287306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bf1d076a-de21-4937-a801-7fc6b88ac700 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:54.287772 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bf1d076a-de21-4937-a801-7fc6b88ac700 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:54.320244 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bf1d076a-de21-4937-a801-7fc6b88ac700 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:54.320602 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bf1d076a-de21-4937-a801-7fc6b88ac700 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:54.321049 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-bf1d076a-de21-4937-a801-7fc6b88ac700 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lazy-loading 'fault' on Instance uuid e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:50:54.387315 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-bf1d076a-de21-4937-a801-7fc6b88ac700 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:54.395944 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-bf1d076a-de21-4937-a801-7fc6b88ac700 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 200 len: 1303 microversion: 2.1 time: 0.122372 Jun 27 15:50:54.396521 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 202/409] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:54 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 1303 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:54.448288 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-eba82c1f-2d35-445c-bb9a-2c19b7778f68 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:54.456540 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-eba82c1f-2d35-445c-bb9a-2c19b7778f68 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1513 microversion: 2.1 time: 0.186451 Jun 27 15:50:54.457106 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 208/410] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:54 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:54.537208 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9ce40aa0-023b-4bae-a8d2-7c4d44ff3f21 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:54.537836 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9ce40aa0-023b-4bae-a8d2-7c4d44ff3f21 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:54.543849 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9ce40aa0-023b-4bae-a8d2-7c4d44ff3f21 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:54.544290 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9ce40aa0-023b-4bae-a8d2-7c4d44ff3f21 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:54.545045 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9ce40aa0-023b-4bae-a8d2-7c4d44ff3f21 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:54.545475 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9ce40aa0-023b-4bae-a8d2-7c4d44ff3f21 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:54.682935 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9ce40aa0-023b-4bae-a8d2-7c4d44ff3f21 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:54.692038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9ce40aa0-023b-4bae-a8d2-7c4d44ff3f21 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1710 microversion: 2.1 time: 0.159189 Jun 27 15:50:54.692606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 203/411] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:54 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1710 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:55.255071 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e5f51601-df62-4bd5-806c-d4f462baae74 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:55.255777 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e5f51601-df62-4bd5-806c-d4f462baae74 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:55.262392 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e5f51601-df62-4bd5-806c-d4f462baae74 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:55.263337 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e5f51601-df62-4bd5-806c-d4f462baae74 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:55.263606 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e5f51601-df62-4bd5-806c-d4f462baae74 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:55.264083 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e5f51601-df62-4bd5-806c-d4f462baae74 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:55.291246 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-66e13d1e-b922-4797-a70d-e275771d423b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:55.294444 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-66e13d1e-b922-4797-a70d-e275771d423b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:55.302718 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-66e13d1e-b922-4797-a70d-e275771d423b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:55.303233 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-66e13d1e-b922-4797-a70d-e275771d423b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:55.304020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-66e13d1e-b922-4797-a70d-e275771d423b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:55.304456 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-66e13d1e-b922-4797-a70d-e275771d423b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:55.516777 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e5f51601-df62-4bd5-806c-d4f462baae74 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:55.526746 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e5f51601-df62-4bd5-806c-d4f462baae74 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1265 microversion: 2.1 time: 0.275564 Jun 27 15:50:55.537617 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 209/412] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:55 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:55.543247 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-9cd67843-56bf-475a-9e24-c985571c1aeb tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:55.544131 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-9cd67843-56bf-475a-9e24-c985571c1aeb tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: e1639393-7ae9-4f69-8a8d-abc1a3eb39f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:55.545762 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-66e13d1e-b922-4797-a70d-e275771d423b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:55.552917 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9cd67843-56bf-475a-9e24-c985571c1aeb tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:55.554483 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9cd67843-56bf-475a-9e24-c985571c1aeb tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:55.555920 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9cd67843-56bf-475a-9e24-c985571c1aeb tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:55.557278 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9cd67843-56bf-475a-9e24-c985571c1aeb tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:55.559550 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-66e13d1e-b922-4797-a70d-e275771d423b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1563 microversion: 2.1 time: 0.276982 Jun 27 15:50:55.560943 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 204/413] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:55 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1563 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:55.567690 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-33a5aeaa-350f-4855-a8bc-81f3a8f342ed tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:55.569384 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-33a5aeaa-350f-4855-a8bc-81f3a8f342ed tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:55.576242 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-33a5aeaa-350f-4855-a8bc-81f3a8f342ed tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:55.576837 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-33a5aeaa-350f-4855-a8bc-81f3a8f342ed tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:55.577041 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-9cd67843-56bf-475a-9e24-c985571c1aeb tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] HTTP exception thrown: Instance e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 could not be found. Jun 27 15:50:55.577852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-33a5aeaa-350f-4855-a8bc-81f3a8f342ed tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:55.578357 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-33a5aeaa-350f-4855-a8bc-81f3a8f342ed tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-9cd67843-56bf-475a-9e24-c985571c1aeb tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Request method failure captured: Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 HTTP/1.1 Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudG7JE0F2arAqezeSwdMuo8kaykgVx_ZrhGSNLKPz6VtT8WxJ0QIYgY_SrA2IOlRjpCz2NXTrtNz14noJX9NFiJV2B1SXb50T00X19bKQfK4Gt_YIhVTfkGvsZPHHkO8pDClBhIR1gufgTGqfLbK_J4tMaq11_1af6Y_WJ0i12bCsDc Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 74b7ceb2cdb24fe0b504de90f017ce0f Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-VolumesActionsTest-518805029 Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:50:55.581205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:50:55.583401 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74b7ceb2cdb24fe0b504de90f017ce0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74b7ceb2cdb24fe0b504de90f017ce0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74b7ceb2cdb24fe0b504de90f017ce0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74b7ceb2cdb24fe0b504de90f017ce0f", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:50:55.583401 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-VolumesActionsTest-518805029 Jun 27 15:50:55.583401 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 74b7ceb2cdb24fe0b504de90f017ce0f Jun 27 15:50:55.583401 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-VolumesActionsTest-518805029 Jun 27 15:50:55.583401 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-VolumesActionsTest-518805029-project Jun 27 15:50:55.583401 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:50:55.583401 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:50:55.583401 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 0c60a904281841fc8773877812f0b8bc Jun 27 15:50:55.583401 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-VolumesActionsTest-518805029-project Jun 27 15:50:55.583401 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:50:55.583401 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 could not be found. Jun 27 15:50:55.583401 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': 'e1639393-7ae9-4f69-8a8d-abc1a3eb39f6'} Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 could not be found. Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:50:55.584780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:50:55.586389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:50:55.586389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:50:55.586389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:50:55.586389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:50:55.586389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:50:55.586389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:50:55.586389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:50:55.586389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 could not be found. Jun 27 15:50:55.586389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:50:55.586389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:50:55.586389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:50:55.586389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:50:55.586389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:50:55.586389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:50:55.586389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:50:55.586389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:50:55.586389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 could not be found. Jun 27 15:50:55.586389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:50:55.588612 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-9cd67843-56bf-475a-9e24-c985571c1aeb tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Returning 404 to user: Instance e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:50:55.588612 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-9cd67843-56bf-475a-9e24-c985571c1aeb tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6" status: 404 len: 111 microversion: 2.1 time: 0.047852 Jun 27 15:50:55.589999 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 210/414] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:55 2022] GET /compute/v2.1/servers/e1639393-7ae9-4f69-8a8d-abc1a3eb39f6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:50:55.602820 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3a21e54b-a1f3-4216-ba8a-8b247624cf98 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:55.603406 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3a21e54b-a1f3-4216-ba8a-8b247624cf98 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:55.621988 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3a21e54b-a1f3-4216-ba8a-8b247624cf98 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:55.622502 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3a21e54b-a1f3-4216-ba8a-8b247624cf98 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:55.627752 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3a21e54b-a1f3-4216-ba8a-8b247624cf98 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:55.628225 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3a21e54b-a1f3-4216-ba8a-8b247624cf98 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:55.672688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-33a5aeaa-350f-4855-a8bc-81f3a8f342ed tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:55.682131 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-33a5aeaa-350f-4855-a8bc-81f3a8f342ed tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1471 microversion: 2.1 time: 0.119955 Jun 27 15:50:55.682720 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 205/415] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:55 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1471 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:55.692737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-eba49f02-e742-4988-91d4-e49186fdde71 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-568374158", "imageRef": "11f9be98-90d6-4c67-8d66-0b944f5a2a2b", "flavorRef": "452", "networks": [{"uuid": "0f99c94d-8766-415b-910e-c27c88f40cf0"}]}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:55.739034 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3a21e54b-a1f3-4216-ba8a-8b247624cf98 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147782 Jun 27 15:50:55.739601 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 211/416] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jun 27 15:50:55 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:50:55.744219 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-f38aae44-c104-4438-8609-1baf94edcbd4 req-6f628c66-45b7-4b3e-99ee-08ec7354e46f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49d4234-4e82-48ef-985d-fa848a6856f7", "name": "network-vif-deleted", "tag": "9e89bfc5-9bbf-4ad7-82cc-2097bfc80839"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:55.746562 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.network.neutron [None req-eba49f02-e742-4988-91d4-e49186fdde71 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] validate_networks() for [('0f99c94d-8766-415b-910e-c27c88f40cf0', None, None, None, None, None)] {{(pid=129472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:50:55.753223 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-f38aae44-c104-4438-8609-1baf94edcbd4 req-6f628c66-45b7-4b3e-99ee-08ec7354e46f service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:55.753810 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-f38aae44-c104-4438-8609-1baf94edcbd4 req-6f628c66-45b7-4b3e-99ee-08ec7354e46f service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:55.767034 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-f38aae44-c104-4438-8609-1baf94edcbd4 req-6f628c66-45b7-4b3e-99ee-08ec7354e46f service nova] Creating event network-vif-deleted:9e89bfc5-9bbf-4ad7-82cc-2097bfc80839 for instance d49d4234-4e82-48ef-985d-fa848a6856f7 on hv-cinder-84780 Jun 27 15:50:55.772811 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-f38aae44-c104-4438-8609-1baf94edcbd4 req-6f628c66-45b7-4b3e-99ee-08ec7354e46f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032079 Jun 27 15:50:55.773616 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 212/417] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:50:55.778430 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-45db4492-4db2-44ce-a56a-7620a485e20f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:55.779268 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-45db4492-4db2-44ce-a56a-7620a485e20f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:55.785781 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-45db4492-4db2-44ce-a56a-7620a485e20f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:55.786236 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-45db4492-4db2-44ce-a56a-7620a485e20f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:55.787010 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-45db4492-4db2-44ce-a56a-7620a485e20f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:55.787446 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-45db4492-4db2-44ce-a56a-7620a485e20f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:56.195666 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-45db4492-4db2-44ce-a56a-7620a485e20f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:56.204674 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-45db4492-4db2-44ce-a56a-7620a485e20f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1710 microversion: 2.1 time: 0.429963 Jun 27 15:50:56.206182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 213/418] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:55 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1710 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:56.352709 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=2 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:56.383574 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=6 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:56.544434 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-91366575-e775-4985-a13b-16d7d8fd89c8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:56.545044 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-91366575-e775-4985-a13b-16d7d8fd89c8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:56.552733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-91366575-e775-4985-a13b-16d7d8fd89c8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:56.553185 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-91366575-e775-4985-a13b-16d7d8fd89c8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:56.554008 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-91366575-e775-4985-a13b-16d7d8fd89c8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:56.554445 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-91366575-e775-4985-a13b-16d7d8fd89c8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:56.559634 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:56.648759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-eba49f02-e742-4988-91d4-e49186fdde71 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Flavor limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:50:56.649249 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-eba49f02-e742-4988-91d4-e49186fdde71 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Image limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:50:56.649865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-eba49f02-e742-4988-91d4-e49186fdde71 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Flavor pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:50:56.650450 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-eba49f02-e742-4988-91d4-e49186fdde71 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Image pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:50:56.650927 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-eba49f02-e742-4988-91d4-e49186fdde71 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:50:56.662201 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-eba49f02-e742-4988-91d4-e49186fdde71 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:56.663552 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-eba49f02-e742-4988-91d4-e49186fdde71 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:56.663552 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-eba49f02-e742-4988-91d4-e49186fdde71 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:56.664148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-eba49f02-e742-4988-91d4-e49186fdde71 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:56.671051 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=2 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:50:56.693587 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-eba49f02-e742-4988-91d4-e49186fdde71 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Getting quotas for project 74b7ceb2cdb24fe0b504de90f017ce0f. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:50:56.699075 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-eba49f02-e742-4988-91d4-e49186fdde71 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Getting quotas for user 0c60a904281841fc8773877812f0b8bc and project 74b7ceb2cdb24fe0b504de90f017ce0f. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:50:56.721517 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-eba49f02-e742-4988-91d4-e49186fdde71 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Going to run 1 instances... {{(pid=129472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:50:56.724578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-eba49f02-e742-4988-91d4-e49186fdde71 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11f9be98-90d6-4c67-8d66-0b944f5a2a2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:50:56.784795 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-eba49f02-e742-4988-91d4-e49186fdde71 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.100939 Jun 27 15:50:56.790459 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 206/419] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 15:50:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:50:56.791744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ac9ae0d7-5be0-49bb-9f66-28410eec76d3 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:56.792801 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-ac9ae0d7-5be0-49bb-9f66-28410eec76d3 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:56.800172 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ac9ae0d7-5be0-49bb-9f66-28410eec76d3 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:56.800634 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ac9ae0d7-5be0-49bb-9f66-28410eec76d3 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:56.801573 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ac9ae0d7-5be0-49bb-9f66-28410eec76d3 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:56.802043 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ac9ae0d7-5be0-49bb-9f66-28410eec76d3 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:56.836488 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ac9ae0d7-5be0-49bb-9f66-28410eec76d3 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:56.836816 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ac9ae0d7-5be0-49bb-9f66-28410eec76d3 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:56.837294 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-ac9ae0d7-5be0-49bb-9f66-28410eec76d3 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lazy-loading 'fault' on Instance uuid d49d4234-4e82-48ef-985d-fa848a6856f7 {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:50:56.845704 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-91366575-e775-4985-a13b-16d7d8fd89c8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:56.853776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-91366575-e775-4985-a13b-16d7d8fd89c8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1265 microversion: 2.1 time: 0.313115 Jun 27 15:50:56.854355 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 214/420] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:56 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1265 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:50:56.859128 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-118cd3af-ff6a-4387-97cf-e7a49f9ce968 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:56.860817 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-118cd3af-ff6a-4387-97cf-e7a49f9ce968 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:56.929945 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ac9ae0d7-5be0-49bb-9f66-28410eec76d3 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:56.938097 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ac9ae0d7-5be0-49bb-9f66-28410eec76d3 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 200 len: 1308 microversion: 2.1 time: 0.151504 Jun 27 15:50:56.938931 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 207/421] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:56 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 1308 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:56.964062 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-118cd3af-ff6a-4387-97cf-e7a49f9ce968 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:56.971686 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-118cd3af-ff6a-4387-97cf-e7a49f9ce968 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1213 microversion: 2.1 time: 0.116019 Jun 27 15:50:56.980955 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 215/422] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:56 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1213 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:57.227372 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-788ba301-4784-4a2a-9ce0-d7d9550b4110 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:57.227994 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-788ba301-4784-4a2a-9ce0-d7d9550b4110 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:57.234712 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-788ba301-4784-4a2a-9ce0-d7d9550b4110 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:57.235168 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-788ba301-4784-4a2a-9ce0-d7d9550b4110 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:57.235988 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-788ba301-4784-4a2a-9ce0-d7d9550b4110 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:57.236510 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-788ba301-4784-4a2a-9ce0-d7d9550b4110 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:57.537307 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-788ba301-4784-4a2a-9ce0-d7d9550b4110 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:57.545753 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-788ba301-4784-4a2a-9ce0-d7d9550b4110 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1714 microversion: 2.1 time: 0.322078 Jun 27 15:50:57.557714 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 208/423] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:57 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1714 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:57.663967 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-66bc25f1-a18c-4879-b271-1b2c6dae96a4 req-750e1cd7-6f29-41cd-aa12-22ff2f67a844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "936500ce-291e-420d-be24-d5a7919350f6", "tag": "df282c39-1e8b-43bd-9dde-0ce20496061e"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:50:57.677376 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-66bc25f1-a18c-4879-b271-1b2c6dae96a4 req-750e1cd7-6f29-41cd-aa12-22ff2f67a844 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:57.678413 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-66bc25f1-a18c-4879-b271-1b2c6dae96a4 req-750e1cd7-6f29-41cd-aa12-22ff2f67a844 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:57.691970 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-66bc25f1-a18c-4879-b271-1b2c6dae96a4 req-750e1cd7-6f29-41cd-aa12-22ff2f67a844 service nova] Creating event network-changed:df282c39-1e8b-43bd-9dde-0ce20496061e for instance 936500ce-291e-420d-be24-d5a7919350f6 on hv-cinder-84780 Jun 27 15:50:57.698149 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-66bc25f1-a18c-4879-b271-1b2c6dae96a4 req-750e1cd7-6f29-41cd-aa12-22ff2f67a844 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038336 Jun 27 15:50:57.699826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 216/424] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:50:57.872279 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-804fc45a-fdb3-453b-86d5-7114937825d5 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:57.872884 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-804fc45a-fdb3-453b-86d5-7114937825d5 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:57.879359 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-804fc45a-fdb3-453b-86d5-7114937825d5 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:57.879807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-804fc45a-fdb3-453b-86d5-7114937825d5 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:57.880568 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-804fc45a-fdb3-453b-86d5-7114937825d5 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:57.881028 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-804fc45a-fdb3-453b-86d5-7114937825d5 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:57.959977 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-5c6a2672-5d39-41fc-9c0c-8f7590b8164a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:57.960987 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-5c6a2672-5d39-41fc-9c0c-8f7590b8164a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: d49d4234-4e82-48ef-985d-fa848a6856f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:57.967845 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5c6a2672-5d39-41fc-9c0c-8f7590b8164a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:57.968301 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5c6a2672-5d39-41fc-9c0c-8f7590b8164a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:57.969074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5c6a2672-5d39-41fc-9c0c-8f7590b8164a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:57.969726 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5c6a2672-5d39-41fc-9c0c-8f7590b8164a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:57.985422 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-5c6a2672-5d39-41fc-9c0c-8f7590b8164a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] HTTP exception thrown: Instance d49d4234-4e82-48ef-985d-fa848a6856f7 could not be found. Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-5c6a2672-5d39-41fc-9c0c-8f7590b8164a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Request method failure captured: Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 HTTP/1.1 Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudGGvcaNKNcPQGmXgdczKrEw5Ln8wRiI3Gpt4ucivFcygtPN5xdZkiRHoIC8ZbGQXRDoY1aupFuzN9NFNJWrgRIEzbszVNVux-QNPjLs31AF0qErfp16sS9TVasQuYT2mtprHwXxeDuZqu8k_2fXetlHrJiQ46K6mAiAJMEQmyXtM3w Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: e552ed97892f41259a1d7057aea64f6b Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1860429310 Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:50:57.987274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:50:57.988775 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e552ed97892f41259a1d7057aea64f6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e552ed97892f41259a1d7057aea64f6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e552ed97892f41259a1d7057aea64f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e552ed97892f41259a1d7057aea64f6b", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:50:57.988775 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-VolumesSnapshotTestJSON-1860429310 Jun 27 15:50:57.988775 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: e552ed97892f41259a1d7057aea64f6b Jun 27 15:50:57.988775 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1860429310 Jun 27 15:50:57.988775 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-VolumesSnapshotTestJSON-1860429310-project Jun 27 15:50:57.988775 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:50:57.988775 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:50:57.988775 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 7432931bd04d45bcaee686df05d5c5b3 Jun 27 15:50:57.988775 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-VolumesSnapshotTestJSON-1860429310-project Jun 27 15:50:57.988775 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:50:57.988775 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance d49d4234-4e82-48ef-985d-fa848a6856f7 could not be found. Jun 27 15:50:57.988775 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': 'd49d4234-4e82-48ef-985d-fa848a6856f7'} Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49d4234-4e82-48ef-985d-fa848a6856f7 could not be found. Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:50:57.989727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:50:57.991088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:50:57.991088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:50:57.991088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:50:57.991088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:50:57.991088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:50:57.991088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:50:57.991088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:50:57.991088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49d4234-4e82-48ef-985d-fa848a6856f7 could not be found. Jun 27 15:50:57.991088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:50:57.991088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:50:57.991088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:50:57.991088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:50:57.991088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:50:57.991088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:50:57.991088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:50:57.991088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:50:57.991088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49d4234-4e82-48ef-985d-fa848a6856f7 could not be found. Jun 27 15:50:57.991088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:50:57.992501 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-5c6a2672-5d39-41fc-9c0c-8f7590b8164a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Returning 404 to user: Instance d49d4234-4e82-48ef-985d-fa848a6856f7 could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:50:57.992501 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-5c6a2672-5d39-41fc-9c0c-8f7590b8164a tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7" status: 404 len: 111 microversion: 2.1 time: 0.035529 Jun 27 15:50:57.995442 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 217/425] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:57 2022] GET /compute/v2.1/servers/d49d4234-4e82-48ef-985d-fa848a6856f7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:50:58.008287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-503e5646-5aac-4013-b1ae-ea80198bb637 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:58.009288 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-503e5646-5aac-4013-b1ae-ea80198bb637 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:58.018224 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-503e5646-5aac-4013-b1ae-ea80198bb637 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:58.019508 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-503e5646-5aac-4013-b1ae-ea80198bb637 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:58.020480 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-503e5646-5aac-4013-b1ae-ea80198bb637 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:58.022131 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-503e5646-5aac-4013-b1ae-ea80198bb637 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:58.051941 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-804fc45a-fdb3-453b-86d5-7114937825d5 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:58.061281 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-804fc45a-fdb3-453b-86d5-7114937825d5 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1265 microversion: 2.1 time: 0.193014 Jun 27 15:50:58.062164 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 209/426] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:57 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:58.098509 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-503e5646-5aac-4013-b1ae-ea80198bb637 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:58.106367 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-503e5646-5aac-4013-b1ae-ea80198bb637 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1265 microversion: 2.1 time: 0.108333 Jun 27 15:50:58.106940 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 218/427] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:57 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1265 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:59.078978 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-10dfcbcd-19d9-4904-9fff-9af120755e95 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:59.079731 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-10dfcbcd-19d9-4904-9fff-9af120755e95 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:59.086848 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-10dfcbcd-19d9-4904-9fff-9af120755e95 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:59.087292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-10dfcbcd-19d9-4904-9fff-9af120755e95 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:59.088052 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-10dfcbcd-19d9-4904-9fff-9af120755e95 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:59.088507 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-10dfcbcd-19d9-4904-9fff-9af120755e95 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:59.124452 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-496f7a78-56fc-4c48-b51e-16fb445b2089 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:50:59.125147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-496f7a78-56fc-4c48-b51e-16fb445b2089 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:50:59.132729 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-496f7a78-56fc-4c48-b51e-16fb445b2089 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:59.133178 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-496f7a78-56fc-4c48-b51e-16fb445b2089 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:59.134003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-496f7a78-56fc-4c48-b51e-16fb445b2089 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:50:59.134432 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-496f7a78-56fc-4c48-b51e-16fb445b2089 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:50:59.297232 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-10dfcbcd-19d9-4904-9fff-9af120755e95 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:59.305190 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-10dfcbcd-19d9-4904-9fff-9af120755e95 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1265 microversion: 2.1 time: 0.230123 Jun 27 15:50:59.305811 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 210/428] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:59 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:50:59.328324 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-496f7a78-56fc-4c48-b51e-16fb445b2089 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:50:59.337218 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-496f7a78-56fc-4c48-b51e-16fb445b2089 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1313 microversion: 2.1 time: 0.216872 Jun 27 15:50:59.337836 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 219/429] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:50:59 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:51:00.322077 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-09692dff-b3a2-4949-afd1-c0d8712f3555 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:00.322682 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-09692dff-b3a2-4949-afd1-c0d8712f3555 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:00.329239 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-09692dff-b3a2-4949-afd1-c0d8712f3555 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:00.329730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-09692dff-b3a2-4949-afd1-c0d8712f3555 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:00.330531 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-09692dff-b3a2-4949-afd1-c0d8712f3555 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:00.330929 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-09692dff-b3a2-4949-afd1-c0d8712f3555 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:00.354724 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-7bbefda8-9977-4b52-837b-2269275328d5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:00.355420 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-7bbefda8-9977-4b52-837b-2269275328d5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:00.362638 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7bbefda8-9977-4b52-837b-2269275328d5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:00.363166 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7bbefda8-9977-4b52-837b-2269275328d5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:00.363998 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7bbefda8-9977-4b52-837b-2269275328d5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:00.364432 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7bbefda8-9977-4b52-837b-2269275328d5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:00.520484 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-09692dff-b3a2-4949-afd1-c0d8712f3555 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:00.528085 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-09692dff-b3a2-4949-afd1-c0d8712f3555 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1265 microversion: 2.1 time: 0.209722 Jun 27 15:51:00.528817 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 211/430] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:00 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:00.549489 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-7bbefda8-9977-4b52-837b-2269275328d5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:00.556990 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-7bbefda8-9977-4b52-837b-2269275328d5 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1313 microversion: 2.1 time: 0.206038 Jun 27 15:51:00.557552 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 220/431] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:00 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:51:01.550289 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-2f4a21ac-80c3-453a-b06b-760caed1df89 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:01.551929 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-2f4a21ac-80c3-453a-b06b-760caed1df89 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:01.561092 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2f4a21ac-80c3-453a-b06b-760caed1df89 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:01.561656 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2f4a21ac-80c3-453a-b06b-760caed1df89 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:01.562595 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2f4a21ac-80c3-453a-b06b-760caed1df89 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:01.563118 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2f4a21ac-80c3-453a-b06b-760caed1df89 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:01.579139 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-7b5d886c-800c-49aa-b5dc-6d1fd8258cf8 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:01.580942 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-7b5d886c-800c-49aa-b5dc-6d1fd8258cf8 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:01.591993 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7b5d886c-800c-49aa-b5dc-6d1fd8258cf8 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:01.593142 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7b5d886c-800c-49aa-b5dc-6d1fd8258cf8 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:01.594609 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7b5d886c-800c-49aa-b5dc-6d1fd8258cf8 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:01.595541 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7b5d886c-800c-49aa-b5dc-6d1fd8258cf8 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:01.905094 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-2f4a21ac-80c3-453a-b06b-760caed1df89 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:01.914628 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-2f4a21ac-80c3-453a-b06b-760caed1df89 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1265 microversion: 2.1 time: 0.371256 Jun 27 15:51:01.915207 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 212/432] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:01 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1265 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:01.927216 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-7b5d886c-800c-49aa-b5dc-6d1fd8258cf8 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:01.935327 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-7b5d886c-800c-49aa-b5dc-6d1fd8258cf8 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1313 microversion: 2.1 time: 0.364826 Jun 27 15:51:01.935976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 221/433] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:01 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:02.067813 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-cbab6603-e1fd-41be-96fc-45f885ddc1da req-558d30d5-6d53-4e03-b751-10dc7d3162c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6745ad45-feb1-4097-a737-47c1cd2ce6e7", "tag": "12aaa38f-edc0-4d81-ba22-2fa2d28d2bc0"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:51:02.076819 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-cbab6603-e1fd-41be-96fc-45f885ddc1da req-558d30d5-6d53-4e03-b751-10dc7d3162c3 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:02.077272 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-cbab6603-e1fd-41be-96fc-45f885ddc1da req-558d30d5-6d53-4e03-b751-10dc7d3162c3 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:02.092143 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-cbab6603-e1fd-41be-96fc-45f885ddc1da req-558d30d5-6d53-4e03-b751-10dc7d3162c3 service nova] Creating event network-changed:12aaa38f-edc0-4d81-ba22-2fa2d28d2bc0 for instance 6745ad45-feb1-4097-a737-47c1cd2ce6e7 on hv-cinder-84780 Jun 27 15:51:02.098536 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-cbab6603-e1fd-41be-96fc-45f885ddc1da req-558d30d5-6d53-4e03-b751-10dc7d3162c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034348 Jun 27 15:51:02.099333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 213/434] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:51:02.932108 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-bbc3440c-4218-4c88-abcc-fa99ec17f164 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:02.932715 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-bbc3440c-4218-4c88-abcc-fa99ec17f164 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:02.940033 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bbc3440c-4218-4c88-abcc-fa99ec17f164 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:02.940478 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bbc3440c-4218-4c88-abcc-fa99ec17f164 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:02.941245 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bbc3440c-4218-4c88-abcc-fa99ec17f164 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:02.941710 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bbc3440c-4218-4c88-abcc-fa99ec17f164 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:02.952630 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-e04ab60d-f5c9-46d7-8467-1670ba54d383 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:02.953251 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-e04ab60d-f5c9-46d7-8467-1670ba54d383 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:02.960414 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e04ab60d-f5c9-46d7-8467-1670ba54d383 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:02.960866 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e04ab60d-f5c9-46d7-8467-1670ba54d383 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:02.961646 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e04ab60d-f5c9-46d7-8467-1670ba54d383 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:02.962098 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e04ab60d-f5c9-46d7-8467-1670ba54d383 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:03.131704 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-bbc3440c-4218-4c88-abcc-fa99ec17f164 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:03.139301 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-bbc3440c-4218-4c88-abcc-fa99ec17f164 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1265 microversion: 2.1 time: 0.211004 Jun 27 15:51:03.139875 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 222/435] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:02 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:03.154546 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-e04ab60d-f5c9-46d7-8467-1670ba54d383 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:03.159148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=100 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:51:03.164203 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-e04ab60d-f5c9-46d7-8467-1670ba54d383 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1313 microversion: 2.1 time: 0.215782 Jun 27 15:51:03.164766 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 214/436] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:02 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:51:04.156350 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4ae84da6-0306-4e19-9a9e-1ec90c7b434b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:04.156974 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-4ae84da6-0306-4e19-9a9e-1ec90c7b434b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:04.164295 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4ae84da6-0306-4e19-9a9e-1ec90c7b434b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:04.164739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4ae84da6-0306-4e19-9a9e-1ec90c7b434b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:04.165514 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4ae84da6-0306-4e19-9a9e-1ec90c7b434b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:04.165982 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4ae84da6-0306-4e19-9a9e-1ec90c7b434b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:04.181803 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c277755d-4806-4cac-95f5-3bbd6cc3ad3f tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:04.182415 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c277755d-4806-4cac-95f5-3bbd6cc3ad3f tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:04.191137 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c277755d-4806-4cac-95f5-3bbd6cc3ad3f tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:04.191591 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c277755d-4806-4cac-95f5-3bbd6cc3ad3f tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:04.192389 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c277755d-4806-4cac-95f5-3bbd6cc3ad3f tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:04.192820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c277755d-4806-4cac-95f5-3bbd6cc3ad3f tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:04.374916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4ae84da6-0306-4e19-9a9e-1ec90c7b434b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:04.384074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4ae84da6-0306-4e19-9a9e-1ec90c7b434b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1265 microversion: 2.1 time: 0.231680 Jun 27 15:51:04.384793 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 223/437] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:04 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:04.386974 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-c277755d-4806-4cac-95f5-3bbd6cc3ad3f tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:04.395355 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c277755d-4806-4cac-95f5-3bbd6cc3ad3f tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1313 microversion: 2.1 time: 0.217450 Jun 27 15:51:04.395927 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 215/438] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:04 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:51:05.402014 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-1a4ec086-53b0-477d-b709-634ebc894b6c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:05.402625 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-1a4ec086-53b0-477d-b709-634ebc894b6c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:05.409953 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1a4ec086-53b0-477d-b709-634ebc894b6c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:05.410400 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1a4ec086-53b0-477d-b709-634ebc894b6c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:05.411123 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-2507db23-d279-457c-8f15-83c2d47ab86b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:05.411590 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1a4ec086-53b0-477d-b709-634ebc894b6c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:05.411590 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1a4ec086-53b0-477d-b709-634ebc894b6c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:05.411780 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-2507db23-d279-457c-8f15-83c2d47ab86b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:05.418406 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2507db23-d279-457c-8f15-83c2d47ab86b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:05.418859 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2507db23-d279-457c-8f15-83c2d47ab86b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:05.419668 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2507db23-d279-457c-8f15-83c2d47ab86b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:05.420105 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2507db23-d279-457c-8f15-83c2d47ab86b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:05.612098 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-2507db23-d279-457c-8f15-83c2d47ab86b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:05.619627 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-2507db23-d279-457c-8f15-83c2d47ab86b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1313 microversion: 2.1 time: 0.212349 Jun 27 15:51:05.620222 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 216/439] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:05 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:05.620757 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-1a4ec086-53b0-477d-b709-634ebc894b6c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:05.629431 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-1a4ec086-53b0-477d-b709-634ebc894b6c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1265 microversion: 2.1 time: 0.231122 Jun 27 15:51:05.633623 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 224/440] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:05 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:05.932597 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-409855d6-c49d-447a-868d-8aae4fc2ca05 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2120127619", "imageRef": "11f9be98-90d6-4c67-8d66-0b944f5a2a2b", "flavorRef": "452", "networks": [{"uuid": "0821cc96-fee1-43a4-9f94-ea18f3f4f2f5"}]}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:51:05.985619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.network.neutron [None req-409855d6-c49d-447a-868d-8aae4fc2ca05 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] validate_networks() for [('0821cc96-fee1-43a4-9f94-ea18f3f4f2f5', None, None, None, None, None)] {{(pid=129472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:51:06.353467 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-409855d6-c49d-447a-868d-8aae4fc2ca05 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Flavor limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:51:06.353922 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-409855d6-c49d-447a-868d-8aae4fc2ca05 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Image limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:51:06.354394 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-409855d6-c49d-447a-868d-8aae4fc2ca05 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Flavor pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:51:06.354805 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-409855d6-c49d-447a-868d-8aae4fc2ca05 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Image pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:51:06.355213 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-409855d6-c49d-447a-868d-8aae4fc2ca05 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:51:06.365382 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-409855d6-c49d-447a-868d-8aae4fc2ca05 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:06.365869 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-409855d6-c49d-447a-868d-8aae4fc2ca05 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:06.366667 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-409855d6-c49d-447a-868d-8aae4fc2ca05 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:06.367104 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-409855d6-c49d-447a-868d-8aae4fc2ca05 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:06.384280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-409855d6-c49d-447a-868d-8aae4fc2ca05 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Getting quotas for project e552ed97892f41259a1d7057aea64f6b. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:51:06.388269 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-409855d6-c49d-447a-868d-8aae4fc2ca05 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Getting quotas for user 7432931bd04d45bcaee686df05d5c5b3 and project e552ed97892f41259a1d7057aea64f6b. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:51:06.399415 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-409855d6-c49d-447a-868d-8aae4fc2ca05 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Going to run 1 instances... {{(pid=129472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:51:06.401758 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-409855d6-c49d-447a-868d-8aae4fc2ca05 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11f9be98-90d6-4c67-8d66-0b944f5a2a2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:51:06.448083 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-409855d6-c49d-447a-868d-8aae4fc2ca05 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519188 Jun 27 15:51:06.448819 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 217/441] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 15:51:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:51:06.459437 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-de026172-30a1-4b42-a561-c74dd1920c8b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:06.460684 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-de026172-30a1-4b42-a561-c74dd1920c8b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:06.534577 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-de026172-30a1-4b42-a561-c74dd1920c8b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:06.541525 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-de026172-30a1-4b42-a561-c74dd1920c8b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 200 len: 1219 microversion: 2.1 time: 0.086098 Jun 27 15:51:06.542143 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 225/442] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:06 2022] GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:06.636195 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8cf0708c-5197-4156-9a35-c9165437d316 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:06.636877 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8cf0708c-5197-4156-9a35-c9165437d316 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:06.644559 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8cf0708c-5197-4156-9a35-c9165437d316 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:06.645004 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8cf0708c-5197-4156-9a35-c9165437d316 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:06.645798 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8cf0708c-5197-4156-9a35-c9165437d316 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:06.646221 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8cf0708c-5197-4156-9a35-c9165437d316 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:06.647557 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-bab971fe-98d0-4a92-9d7c-a164738dfce3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:06.648535 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-bab971fe-98d0-4a92-9d7c-a164738dfce3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:06.658379 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bab971fe-98d0-4a92-9d7c-a164738dfce3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:06.659586 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bab971fe-98d0-4a92-9d7c-a164738dfce3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:06.660574 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bab971fe-98d0-4a92-9d7c-a164738dfce3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:06.661019 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bab971fe-98d0-4a92-9d7c-a164738dfce3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:06.881796 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8cf0708c-5197-4156-9a35-c9165437d316 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:06.885336 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-bab971fe-98d0-4a92-9d7c-a164738dfce3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:06.889660 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-8cf0708c-5197-4156-9a35-c9165437d316 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1313 microversion: 2.1 time: 0.257238 Jun 27 15:51:06.890227 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 218/443] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:06 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:06.894073 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-bab971fe-98d0-4a92-9d7c-a164738dfce3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1265 microversion: 2.1 time: 0.252093 Jun 27 15:51:06.894646 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 226/444] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:06 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:51:07.559542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-1e977a06-a108-49ce-b759-598fb757895f tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:07.560198 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-1e977a06-a108-49ce-b759-598fb757895f tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:07.568440 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1e977a06-a108-49ce-b759-598fb757895f tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:07.569176 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1e977a06-a108-49ce-b759-598fb757895f tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:07.570038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1e977a06-a108-49ce-b759-598fb757895f tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:07.570490 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1e977a06-a108-49ce-b759-598fb757895f tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:07.660958 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-1e977a06-a108-49ce-b759-598fb757895f tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:07.668832 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-1e977a06-a108-49ce-b759-598fb757895f tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 200 len: 1215 microversion: 2.1 time: 0.113129 Jun 27 15:51:07.669256 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 219/445] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:07 2022] GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 1215 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:07.905784 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-1c3606b4-512c-4d36-ac4b-7acf65b8408e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:07.906549 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-1c3606b4-512c-4d36-ac4b-7acf65b8408e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:07.912536 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ebecaeb9-f7d4-42c8-82fb-aaac5036ef26 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:07.913157 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-ebecaeb9-f7d4-42c8-82fb-aaac5036ef26 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:07.913944 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1c3606b4-512c-4d36-ac4b-7acf65b8408e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:07.914395 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1c3606b4-512c-4d36-ac4b-7acf65b8408e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:07.915158 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1c3606b4-512c-4d36-ac4b-7acf65b8408e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:07.915588 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1c3606b4-512c-4d36-ac4b-7acf65b8408e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:07.920782 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ebecaeb9-f7d4-42c8-82fb-aaac5036ef26 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:07.920782 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ebecaeb9-f7d4-42c8-82fb-aaac5036ef26 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:07.920782 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ebecaeb9-f7d4-42c8-82fb-aaac5036ef26 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:07.921445 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ebecaeb9-f7d4-42c8-82fb-aaac5036ef26 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:08.121660 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ebecaeb9-f7d4-42c8-82fb-aaac5036ef26 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:08.128795 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-1c3606b4-512c-4d36-ac4b-7acf65b8408e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:08.133365 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ebecaeb9-f7d4-42c8-82fb-aaac5036ef26 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1265 microversion: 2.1 time: 0.226216 Jun 27 15:51:08.134212 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 220/446] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:07 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:51:08.145888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-1c3606b4-512c-4d36-ac4b-7acf65b8408e tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1313 microversion: 2.1 time: 0.243867 Jun 27 15:51:08.146531 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 227/447] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:07 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:08.686175 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-e003d9b5-8e39-4eb8-bbb5-dd677285732b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:08.686854 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-e003d9b5-8e39-4eb8-bbb5-dd677285732b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:08.694934 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e003d9b5-8e39-4eb8-bbb5-dd677285732b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:08.695623 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e003d9b5-8e39-4eb8-bbb5-dd677285732b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:08.696495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e003d9b5-8e39-4eb8-bbb5-dd677285732b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:08.696920 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e003d9b5-8e39-4eb8-bbb5-dd677285732b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:08.772394 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-e003d9b5-8e39-4eb8-bbb5-dd677285732b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:08.780000 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-e003d9b5-8e39-4eb8-bbb5-dd677285732b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 200 len: 1277 microversion: 2.1 time: 0.097582 Jun 27 15:51:08.780571 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 221/448] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:08 2022] GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 1277 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:51:09.152552 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4ffa2499-c493-4f81-b98d-fe0963489c76 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:09.153826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-4ffa2499-c493-4f81-b98d-fe0963489c76 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:09.162999 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4ffa2499-c493-4f81-b98d-fe0963489c76 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:09.163806 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4ffa2499-c493-4f81-b98d-fe0963489c76 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:09.164999 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4ffa2499-c493-4f81-b98d-fe0963489c76 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:09.165847 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4ffa2499-c493-4f81-b98d-fe0963489c76 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:09.166582 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9417a74c-2f59-4d20-9f71-25026a975d4c tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:09.167224 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9417a74c-2f59-4d20-9f71-25026a975d4c tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:09.186776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9417a74c-2f59-4d20-9f71-25026a975d4c tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:09.187858 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9417a74c-2f59-4d20-9f71-25026a975d4c tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:09.189513 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9417a74c-2f59-4d20-9f71-25026a975d4c tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:09.190443 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9417a74c-2f59-4d20-9f71-25026a975d4c tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:09.726751 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4ffa2499-c493-4f81-b98d-fe0963489c76 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:09.734162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4ffa2499-c493-4f81-b98d-fe0963489c76 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1265 microversion: 2.1 time: 0.587171 Jun 27 15:51:09.734733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 228/449] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:09 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1265 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:51:09.757738 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9417a74c-2f59-4d20-9f71-25026a975d4c tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:09.765532 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9417a74c-2f59-4d20-9f71-25026a975d4c tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1313 microversion: 2.1 time: 0.604445 Jun 27 15:51:09.766230 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 222/450] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:09 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1313 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:09.798280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0736bb36-0374-4f32-96a2-db036eeae33b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:09.798903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-0736bb36-0374-4f32-96a2-db036eeae33b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:09.805575 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0736bb36-0374-4f32-96a2-db036eeae33b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:09.806053 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0736bb36-0374-4f32-96a2-db036eeae33b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:09.806828 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0736bb36-0374-4f32-96a2-db036eeae33b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:09.807268 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0736bb36-0374-4f32-96a2-db036eeae33b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:10.033795 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-0736bb36-0374-4f32-96a2-db036eeae33b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:10.042895 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-0736bb36-0374-4f32-96a2-db036eeae33b tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 200 len: 1319 microversion: 2.1 time: 0.248804 Jun 27 15:51:10.043480 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 229/451] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:09 2022] GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:10.408101 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-5b39820a-8436-4d5d-a763-b194f04a94d1 req-c5417fb9-5fba-429a-9f3a-68d9d9c79822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adebf4df-d9bb-48ba-b742-bc579f942ad6", "tag": "ba7afe08-9a8a-4d40-bec3-4c356f065ff2"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:51:10.420183 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-5b39820a-8436-4d5d-a763-b194f04a94d1 req-c5417fb9-5fba-429a-9f3a-68d9d9c79822 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:10.420815 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-5b39820a-8436-4d5d-a763-b194f04a94d1 req-c5417fb9-5fba-429a-9f3a-68d9d9c79822 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:10.442011 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-5b39820a-8436-4d5d-a763-b194f04a94d1 req-c5417fb9-5fba-429a-9f3a-68d9d9c79822 service nova] Creating event network-changed:ba7afe08-9a8a-4d40-bec3-4c356f065ff2 for instance adebf4df-d9bb-48ba-b742-bc579f942ad6 on hv-cinder-84780 Jun 27 15:51:10.450064 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-5b39820a-8436-4d5d-a763-b194f04a94d1 req-c5417fb9-5fba-429a-9f3a-68d9d9c79822 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047139 Jun 27 15:51:10.450930 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 223/452] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:51:10.750642 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4728ef55-d2f9-45d4-823c-7db07ab01c20 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:10.751802 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-4728ef55-d2f9-45d4-823c-7db07ab01c20 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:10.760929 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4728ef55-d2f9-45d4-823c-7db07ab01c20 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:10.761371 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4728ef55-d2f9-45d4-823c-7db07ab01c20 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:10.762187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4728ef55-d2f9-45d4-823c-7db07ab01c20 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:10.762626 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4728ef55-d2f9-45d4-823c-7db07ab01c20 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:10.786380 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-759e25d1-5d4e-4aae-ad3e-396b05589b27 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:10.787209 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-759e25d1-5d4e-4aae-ad3e-396b05589b27 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:10.794831 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-759e25d1-5d4e-4aae-ad3e-396b05589b27 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:10.795419 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-759e25d1-5d4e-4aae-ad3e-396b05589b27 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:10.796743 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-759e25d1-5d4e-4aae-ad3e-396b05589b27 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:10.797178 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-759e25d1-5d4e-4aae-ad3e-396b05589b27 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:11.150952 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4728ef55-d2f9-45d4-823c-7db07ab01c20 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:11.164255 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4728ef55-d2f9-45d4-823c-7db07ab01c20 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1265 microversion: 2.1 time: 0.417301 Jun 27 15:51:11.173908 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 230/453] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:10 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1265 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:11.174445 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-759e25d1-5d4e-4aae-ad3e-396b05589b27 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:11.174756 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-577fc341-8f85-4e81-9c24-9c1a1639f787 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:11.174756 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-577fc341-8f85-4e81-9c24-9c1a1639f787 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:11.181109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-577fc341-8f85-4e81-9c24-9c1a1639f787 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:11.181581 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-577fc341-8f85-4e81-9c24-9c1a1639f787 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:11.182382 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-577fc341-8f85-4e81-9c24-9c1a1639f787 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:11.182811 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-577fc341-8f85-4e81-9c24-9c1a1639f787 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:11.186328 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-759e25d1-5d4e-4aae-ad3e-396b05589b27 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1313 microversion: 2.1 time: 0.403806 Jun 27 15:51:11.186805 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 224/454] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:10 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:11.361952 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-577fc341-8f85-4e81-9c24-9c1a1639f787 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:11.370226 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-577fc341-8f85-4e81-9c24-9c1a1639f787 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 200 len: 1319 microversion: 2.1 time: 0.203636 Jun 27 15:51:11.370887 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 231/455] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:11 2022] GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:11.857426 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-98216fad-ee4e-4300-a062-08d9dbbe2a82 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:11.857980 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-98216fad-ee4e-4300-a062-08d9dbbe2a82 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:11.860379 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:51:11.866850 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-98216fad-ee4e-4300-a062-08d9dbbe2a82 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:11.867297 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-98216fad-ee4e-4300-a062-08d9dbbe2a82 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:11.868058 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-98216fad-ee4e-4300-a062-08d9dbbe2a82 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:11.868491 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-98216fad-ee4e-4300-a062-08d9dbbe2a82 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:11.894704 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-98216fad-ee4e-4300-a062-08d9dbbe2a82 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/ips" status: 200 len: 152 microversion: 2.20 time: 0.041113 Jun 27 15:51:11.895284 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 225/456] 10.222.0.20 () {60 vars in 1288 bytes} [Mon Jun 27 15:51:11 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:51:12.188205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0f98781e-65ea-46c5-b1c5-65cedac65db2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:12.189070 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-0f98781e-65ea-46c5-b1c5-65cedac65db2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:12.196525 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0f98781e-65ea-46c5-b1c5-65cedac65db2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:12.196976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0f98781e-65ea-46c5-b1c5-65cedac65db2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:12.197875 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0f98781e-65ea-46c5-b1c5-65cedac65db2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:12.198252 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0f98781e-65ea-46c5-b1c5-65cedac65db2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:12.207050 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-6682f097-ee7c-4896-8f36-54cebf50c6e4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:12.207750 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-6682f097-ee7c-4896-8f36-54cebf50c6e4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:12.217083 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6682f097-ee7c-4896-8f36-54cebf50c6e4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:12.218036 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6682f097-ee7c-4896-8f36-54cebf50c6e4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:12.219450 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6682f097-ee7c-4896-8f36-54cebf50c6e4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:12.220775 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6682f097-ee7c-4896-8f36-54cebf50c6e4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:12.425199 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-0f98781e-65ea-46c5-b1c5-65cedac65db2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:12.434521 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-0f98781e-65ea-46c5-b1c5-65cedac65db2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1265 microversion: 2.1 time: 0.251213 Jun 27 15:51:12.435111 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 232/457] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:12 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:12.437189 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-6682f097-ee7c-4896-8f36-54cebf50c6e4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:12.440073 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-68f77b1d-4bfb-43b7-8a45-b14ad36fe598 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:12.440726 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-68f77b1d-4bfb-43b7-8a45-b14ad36fe598 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:12.447217 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-68f77b1d-4bfb-43b7-8a45-b14ad36fe598 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:12.447707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-68f77b1d-4bfb-43b7-8a45-b14ad36fe598 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:12.448424 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-68f77b1d-4bfb-43b7-8a45-b14ad36fe598 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:12.448851 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-68f77b1d-4bfb-43b7-8a45-b14ad36fe598 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:12.451235 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-6682f097-ee7c-4896-8f36-54cebf50c6e4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1313 microversion: 2.1 time: 0.248420 Jun 27 15:51:12.453323 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 226/458] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:12 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:12.682291 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-68f77b1d-4bfb-43b7-8a45-b14ad36fe598 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:12.690900 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-68f77b1d-4bfb-43b7-8a45-b14ad36fe598 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 200 len: 1319 microversion: 2.1 time: 0.254694 Jun 27 15:51:12.691570 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 233/459] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:12 2022] GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:12.739867 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-e8c23615-4fc7-41b7-9409-a49270a10c43 req-342453b7-7a2e-4475-97db-d606946e1fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a90fed-157b-47f0-bd62-401e29342025", "name": "network-vif-plugged", "status": "completed", "tag": "7f8f5cac-5782-481c-b444-127b88873db3"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:51:12.749541 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-e8c23615-4fc7-41b7-9409-a49270a10c43 req-342453b7-7a2e-4475-97db-d606946e1fd5 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:12.750220 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-e8c23615-4fc7-41b7-9409-a49270a10c43 req-342453b7-7a2e-4475-97db-d606946e1fd5 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:12.763901 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-e8c23615-4fc7-41b7-9409-a49270a10c43 req-342453b7-7a2e-4475-97db-d606946e1fd5 service nova] Creating event network-vif-plugged:7f8f5cac-5782-481c-b444-127b88873db3 for instance b6a90fed-157b-47f0-bd62-401e29342025 on hv-cinder-84780 Jun 27 15:51:12.770815 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-e8c23615-4fc7-41b7-9409-a49270a10c43 req-342453b7-7a2e-4475-97db-d606946e1fd5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035258 Jun 27 15:51:12.772083 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 227/460] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:51:13.452041 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c0a73a21-fe92-48ab-92b4-d3cb24c73709 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:13.452568 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c0a73a21-fe92-48ab-92b4-d3cb24c73709 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:13.460395 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c0a73a21-fe92-48ab-92b4-d3cb24c73709 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:13.460842 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c0a73a21-fe92-48ab-92b4-d3cb24c73709 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:13.461608 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c0a73a21-fe92-48ab-92b4-d3cb24c73709 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:13.462070 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c0a73a21-fe92-48ab-92b4-d3cb24c73709 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:13.464781 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=100 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:51:13.471558 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-bfa12a81-0c70-449b-a31c-f0de2ab0b79b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:13.473053 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-bfa12a81-0c70-449b-a31c-f0de2ab0b79b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:13.480593 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bfa12a81-0c70-449b-a31c-f0de2ab0b79b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:13.481310 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bfa12a81-0c70-449b-a31c-f0de2ab0b79b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:13.482415 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bfa12a81-0c70-449b-a31c-f0de2ab0b79b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:13.482853 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bfa12a81-0c70-449b-a31c-f0de2ab0b79b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:13.677545 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-c0a73a21-fe92-48ab-92b4-d3cb24c73709 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:13.680698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-bfa12a81-0c70-449b-a31c-f0de2ab0b79b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:13.685403 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c0a73a21-fe92-48ab-92b4-d3cb24c73709 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1265 microversion: 2.1 time: 0.237270 Jun 27 15:51:13.686011 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 234/461] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:13 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:13.688333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-bfa12a81-0c70-449b-a31c-f0de2ab0b79b tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1313 microversion: 2.1 time: 0.222242 Jun 27 15:51:13.689662 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 228/462] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:13 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:51:13.709299 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-78a2dcfd-1de4-4483-8ac5-7177a0f93f64 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:13.709906 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-78a2dcfd-1de4-4483-8ac5-7177a0f93f64 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:13.721193 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-78a2dcfd-1de4-4483-8ac5-7177a0f93f64 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:13.721707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-78a2dcfd-1de4-4483-8ac5-7177a0f93f64 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:13.722536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-78a2dcfd-1de4-4483-8ac5-7177a0f93f64 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:13.722972 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-78a2dcfd-1de4-4483-8ac5-7177a0f93f64 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:13.856950 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-78a2dcfd-1de4-4483-8ac5-7177a0f93f64 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:13.865949 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-78a2dcfd-1de4-4483-8ac5-7177a0f93f64 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 200 len: 1319 microversion: 2.1 time: 0.161206 Jun 27 15:51:13.866528 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 235/463] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:13 2022] GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:14.706235 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-7f303833-ac75-4c9c-9633-7f72d360ed53 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:14.707216 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-7f303833-ac75-4c9c-9633-7f72d360ed53 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:14.708617 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3b073387-fdd6-48c9-bbbf-65b54d5dab42 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:14.709866 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3b073387-fdd6-48c9-bbbf-65b54d5dab42 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:14.717976 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7f303833-ac75-4c9c-9633-7f72d360ed53 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:14.718735 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7f303833-ac75-4c9c-9633-7f72d360ed53 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:14.720610 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7f303833-ac75-4c9c-9633-7f72d360ed53 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:14.721331 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7f303833-ac75-4c9c-9633-7f72d360ed53 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:14.721494 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3b073387-fdd6-48c9-bbbf-65b54d5dab42 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:14.722196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3b073387-fdd6-48c9-bbbf-65b54d5dab42 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:14.723468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3b073387-fdd6-48c9-bbbf-65b54d5dab42 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:14.724209 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3b073387-fdd6-48c9-bbbf-65b54d5dab42 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:14.965487 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-7f303833-ac75-4c9c-9633-7f72d360ed53 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:14.969938 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3b073387-fdd6-48c9-bbbf-65b54d5dab42 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:14.978973 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-7f303833-ac75-4c9c-9633-7f72d360ed53 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1265 microversion: 2.1 time: 0.279275 Jun 27 15:51:14.979938 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 229/464] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:14 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:14.985362 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3b073387-fdd6-48c9-bbbf-65b54d5dab42 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1313 microversion: 2.1 time: 0.283364 Jun 27 15:51:14.988553 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-03ad1d0a-7f7a-4ce1-875e-505a206f211a req-d3a7f0be-c219-41dc-9ca7-8e500d435112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6745ad45-feb1-4097-a737-47c1cd2ce6e7", "name": "network-vif-plugged", "status": "completed", "tag": "12aaa38f-edc0-4d81-ba22-2fa2d28d2bc0"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:51:15.004481 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 236/465] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:14 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:51:15.008258 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-03ad1d0a-7f7a-4ce1-875e-505a206f211a req-d3a7f0be-c219-41dc-9ca7-8e500d435112 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:15.009049 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-03ad1d0a-7f7a-4ce1-875e-505a206f211a req-d3a7f0be-c219-41dc-9ca7-8e500d435112 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:15.010463 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e269bb39-fa89-4094-a40c-c56033a54a54 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:15.011202 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e269bb39-fa89-4094-a40c-c56033a54a54 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:15.018752 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e269bb39-fa89-4094-a40c-c56033a54a54 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:15.019347 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e269bb39-fa89-4094-a40c-c56033a54a54 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:15.020817 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e269bb39-fa89-4094-a40c-c56033a54a54 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:15.021366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e269bb39-fa89-4094-a40c-c56033a54a54 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:15.028855 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-03ad1d0a-7f7a-4ce1-875e-505a206f211a req-d3a7f0be-c219-41dc-9ca7-8e500d435112 service nova] Creating event network-vif-plugged:12aaa38f-edc0-4d81-ba22-2fa2d28d2bc0 for instance 6745ad45-feb1-4097-a737-47c1cd2ce6e7 on hv-cinder-84780 Jun 27 15:51:15.034219 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-03ad1d0a-7f7a-4ce1-875e-505a206f211a req-d3a7f0be-c219-41dc-9ca7-8e500d435112 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052487 Jun 27 15:51:15.035079 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 230/466] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:51:15.040116 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-1e2042b9-ee74-42b9-9220-a6e1a1397fe0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:51:15.040748 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-1e2042b9-ee74-42b9-9220-a6e1a1397fe0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:15.047561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1e2042b9-ee74-42b9-9220-a6e1a1397fe0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:15.048031 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1e2042b9-ee74-42b9-9220-a6e1a1397fe0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:15.048843 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1e2042b9-ee74-42b9-9220-a6e1a1397fe0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:15.049254 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1e2042b9-ee74-42b9-9220-a6e1a1397fe0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:15.075908 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-1e2042b9-ee74-42b9-9220-a6e1a1397fe0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lazy-loading 'flavor' on Instance uuid b9cda787-8842-478e-9fae-1c95d057875f {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:51:15.230859 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e269bb39-fa89-4094-a40c-c56033a54a54 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:15.242327 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e269bb39-fa89-4094-a40c-c56033a54a54 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 200 len: 1319 microversion: 2.1 time: 0.236526 Jun 27 15:51:15.245292 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 237/467] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:15 2022] GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:15.450635 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-1e2042b9-ee74-42b9-9220-a6e1a1397fe0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "POST /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/action" status: 202 len: 0 microversion: 2.20 time: 0.414420 Jun 27 15:51:15.453589 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 231/468] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jun 27 15:51:15 2022] POST /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:51:15.459693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a69cbb85-1248-4552-a918-940a00a6b4ff tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:15.460301 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a69cbb85-1248-4552-a918-940a00a6b4ff tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:15.466952 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a69cbb85-1248-4552-a918-940a00a6b4ff tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:15.467483 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a69cbb85-1248-4552-a918-940a00a6b4ff tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:15.468354 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a69cbb85-1248-4552-a918-940a00a6b4ff tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:15.468869 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a69cbb85-1248-4552-a918-940a00a6b4ff tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:15.660052 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a69cbb85-1248-4552-a918-940a00a6b4ff tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:15.676588 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a69cbb85-1248-4552-a918-940a00a6b4ff tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:15.679457 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a69cbb85-1248-4552-a918-940a00a6b4ff tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:15.681784 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a69cbb85-1248-4552-a918-940a00a6b4ff tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1724 microversion: 2.20 time: 0.225628 Jun 27 15:51:15.682784 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 238/469] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:15 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:15.998356 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d31e2e3a-e939-4b94-8255-77288bb0164e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:15.999413 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d31e2e3a-e939-4b94-8255-77288bb0164e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:16.006406 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d31e2e3a-e939-4b94-8255-77288bb0164e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:16.006861 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d31e2e3a-e939-4b94-8255-77288bb0164e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:16.007642 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d31e2e3a-e939-4b94-8255-77288bb0164e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:16.008087 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d31e2e3a-e939-4b94-8255-77288bb0164e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:16.013923 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-44ca4894-9dba-4002-a318-e3058ed81669 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:16.014836 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-44ca4894-9dba-4002-a318-e3058ed81669 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:16.022607 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-44ca4894-9dba-4002-a318-e3058ed81669 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:16.023132 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-44ca4894-9dba-4002-a318-e3058ed81669 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:16.024104 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-44ca4894-9dba-4002-a318-e3058ed81669 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:16.024599 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-44ca4894-9dba-4002-a318-e3058ed81669 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:16.033292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:51:16.247976 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d31e2e3a-e939-4b94-8255-77288bb0164e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:16.258796 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-44ca4894-9dba-4002-a318-e3058ed81669 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:16.261417 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d31e2e3a-e939-4b94-8255-77288bb0164e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1451 microversion: 2.1 time: 0.267600 Jun 27 15:51:16.262852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 232/470] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:15 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1451 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:16.271407 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f673d3cd-0f47-4dc6-a56e-c69795365b37 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:16.272727 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f673d3cd-0f47-4dc6-a56e-c69795365b37 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:16.277506 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-44ca4894-9dba-4002-a318-e3058ed81669 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1313 microversion: 2.1 time: 0.268343 Jun 27 15:51:16.278727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 239/471] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:16 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:16.284646 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f673d3cd-0f47-4dc6-a56e-c69795365b37 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:16.285496 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f673d3cd-0f47-4dc6-a56e-c69795365b37 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:16.286964 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f673d3cd-0f47-4dc6-a56e-c69795365b37 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:16.287756 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f673d3cd-0f47-4dc6-a56e-c69795365b37 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:16.295658 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d97fedab-838a-434f-9609-4fda2a16530c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:16.297026 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d97fedab-838a-434f-9609-4fda2a16530c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:16.304692 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d97fedab-838a-434f-9609-4fda2a16530c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:16.305145 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d97fedab-838a-434f-9609-4fda2a16530c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:16.305968 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d97fedab-838a-434f-9609-4fda2a16530c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:16.306402 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d97fedab-838a-434f-9609-4fda2a16530c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:16.374534 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=4 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:51:16.395292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=12 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:51:16.539631 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=4 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:51:16.588396 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d97fedab-838a-434f-9609-4fda2a16530c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:16.596160 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f673d3cd-0f47-4dc6-a56e-c69795365b37 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:16.602546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d97fedab-838a-434f-9609-4fda2a16530c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1451 microversion: 2.1 time: 0.310964 Jun 27 15:51:16.603362 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 240/472] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:16 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1451 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:51:16.607781 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f673d3cd-0f47-4dc6-a56e-c69795365b37 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 200 len: 1319 microversion: 2.1 time: 0.343574 Jun 27 15:51:16.608601 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 233/473] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:16 2022] GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:16.714251 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ca7ad2e1-3d2a-4103-a57c-b06ead39025a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:16.715534 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-ca7ad2e1-3d2a-4103-a57c-b06ead39025a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:16.724587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ca7ad2e1-3d2a-4103-a57c-b06ead39025a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:16.725036 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ca7ad2e1-3d2a-4103-a57c-b06ead39025a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:16.725861 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ca7ad2e1-3d2a-4103-a57c-b06ead39025a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:16.726301 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ca7ad2e1-3d2a-4103-a57c-b06ead39025a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:16.897307 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-ca7ad2e1-3d2a-4103-a57c-b06ead39025a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:16.907060 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-ca7ad2e1-3d2a-4103-a57c-b06ead39025a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:16.909146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-ca7ad2e1-3d2a-4103-a57c-b06ead39025a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:16.910395 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-ca7ad2e1-3d2a-4103-a57c-b06ead39025a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1724 microversion: 2.20 time: 0.203521 Jun 27 15:51:16.910964 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 241/474] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:16 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:17.304318 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3413022e-d5c7-48e4-b861-b560e4b8d694 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:17.305178 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3413022e-d5c7-48e4-b861-b560e4b8d694 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:17.315921 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3413022e-d5c7-48e4-b861-b560e4b8d694 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:17.316460 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3413022e-d5c7-48e4-b861-b560e4b8d694 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:17.317801 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3413022e-d5c7-48e4-b861-b560e4b8d694 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:17.318438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3413022e-d5c7-48e4-b861-b560e4b8d694 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:17.486745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3413022e-d5c7-48e4-b861-b560e4b8d694 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:17.496354 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3413022e-d5c7-48e4-b861-b560e4b8d694 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1496 microversion: 2.1 time: 0.195815 Jun 27 15:51:17.497403 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 234/475] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:17 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1496 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:17.625553 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-5858df50-7b8b-4133-81b4-559f21eb9d45 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:17.627299 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-5858df50-7b8b-4133-81b4-559f21eb9d45 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:17.635450 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5858df50-7b8b-4133-81b4-559f21eb9d45 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:17.635920 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5858df50-7b8b-4133-81b4-559f21eb9d45 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:17.636961 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5858df50-7b8b-4133-81b4-559f21eb9d45 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:17.637549 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5858df50-7b8b-4133-81b4-559f21eb9d45 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:17.892993 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-5858df50-7b8b-4133-81b4-559f21eb9d45 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:17.908971 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-5858df50-7b8b-4133-81b4-559f21eb9d45 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 200 len: 1319 microversion: 2.1 time: 0.287318 Jun 27 15:51:17.911172 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 242/476] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:17 2022] GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:17.934259 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-e5088e7a-3b56-4bcd-8993-ad00677d1a1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:17.935420 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-e5088e7a-3b56-4bcd-8993-ad00677d1a1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:17.947137 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-47099713-f7e6-4ae8-b40e-2e95ca4f2bb5 req-c83cdf1a-efe0-4c80-b94a-09a3549fcfbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adebf4df-d9bb-48ba-b742-bc579f942ad6", "name": "network-vif-plugged", "status": "completed", "tag": "ba7afe08-9a8a-4d40-bec3-4c356f065ff2"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:51:17.952228 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e5088e7a-3b56-4bcd-8993-ad00677d1a1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:17.953278 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e5088e7a-3b56-4bcd-8993-ad00677d1a1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:17.955312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e5088e7a-3b56-4bcd-8993-ad00677d1a1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:17.956124 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e5088e7a-3b56-4bcd-8993-ad00677d1a1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:17.965170 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-47099713-f7e6-4ae8-b40e-2e95ca4f2bb5 req-c83cdf1a-efe0-4c80-b94a-09a3549fcfbe service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:17.966254 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-47099713-f7e6-4ae8-b40e-2e95ca4f2bb5 req-c83cdf1a-efe0-4c80-b94a-09a3549fcfbe service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:18.020028 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-47099713-f7e6-4ae8-b40e-2e95ca4f2bb5 req-c83cdf1a-efe0-4c80-b94a-09a3549fcfbe service nova] Creating event network-vif-plugged:ba7afe08-9a8a-4d40-bec3-4c356f065ff2 for instance adebf4df-d9bb-48ba-b742-bc579f942ad6 on hv-cinder-84780 Jun 27 15:51:18.041854 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-47099713-f7e6-4ae8-b40e-2e95ca4f2bb5 req-c83cdf1a-efe0-4c80-b94a-09a3549fcfbe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101720 Jun 27 15:51:18.044372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 243/477] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:51:18.266198 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-e5088e7a-3b56-4bcd-8993-ad00677d1a1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:18.280347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-e5088e7a-3b56-4bcd-8993-ad00677d1a1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:18.284139 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-e5088e7a-3b56-4bcd-8993-ad00677d1a1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:18.286909 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-e5088e7a-3b56-4bcd-8993-ad00677d1a1b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1724 microversion: 2.20 time: 0.359777 Jun 27 15:51:18.287988 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 235/478] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:17 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1724 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:18.519380 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-9b78f50a-02bf-4a5c-8f47-1a2118c420c4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:18.520346 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-9b78f50a-02bf-4a5c-8f47-1a2118c420c4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:18.530740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9b78f50a-02bf-4a5c-8f47-1a2118c420c4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:18.531497 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9b78f50a-02bf-4a5c-8f47-1a2118c420c4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:18.533361 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9b78f50a-02bf-4a5c-8f47-1a2118c420c4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:18.534125 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9b78f50a-02bf-4a5c-8f47-1a2118c420c4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:18.584380 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-9b78f50a-02bf-4a5c-8f47-1a2118c420c4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Going to try to terminate instance {{(pid=129473) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:51:18.707989 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-9b78f50a-02bf-4a5c-8f47-1a2118c420c4 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 204 len: 0 microversion: 2.1 time: 0.195801 Jun 27 15:51:18.714161 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 244/479] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:51:18 2022] DELETE /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:51:18.719688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d43944e8-0bc9-4620-b830-cbf710547efd tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:18.721518 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d43944e8-0bc9-4620-b830-cbf710547efd tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:18.729119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d43944e8-0bc9-4620-b830-cbf710547efd tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:18.730708 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d43944e8-0bc9-4620-b830-cbf710547efd tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:18.731756 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d43944e8-0bc9-4620-b830-cbf710547efd tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:18.732194 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d43944e8-0bc9-4620-b830-cbf710547efd tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:18.899885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d43944e8-0bc9-4620-b830-cbf710547efd tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:18.909947 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d43944e8-0bc9-4620-b830-cbf710547efd tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1502 microversion: 2.1 time: 0.194128 Jun 27 15:51:18.910589 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 236/480] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:18 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1502 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:18.928464 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-601523c1-0066-497f-b005-f215566d301c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:18.929200 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-601523c1-0066-497f-b005-f215566d301c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:18.935527 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-601523c1-0066-497f-b005-f215566d301c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:18.935978 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-601523c1-0066-497f-b005-f215566d301c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:18.936764 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-601523c1-0066-497f-b005-f215566d301c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:18.937200 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-601523c1-0066-497f-b005-f215566d301c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:19.122005 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-601523c1-0066-497f-b005-f215566d301c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:19.134654 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-601523c1-0066-497f-b005-f215566d301c tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 200 len: 1319 microversion: 2.1 time: 0.210135 Jun 27 15:51:19.135613 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 245/481] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:18 2022] GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:51:19.310165 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-044f1e48-ab66-4247-97cf-8bd403ab7a38 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:19.311157 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-044f1e48-ab66-4247-97cf-8bd403ab7a38 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:19.321944 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-044f1e48-ab66-4247-97cf-8bd403ab7a38 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:19.323121 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-044f1e48-ab66-4247-97cf-8bd403ab7a38 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:19.324350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-044f1e48-ab66-4247-97cf-8bd403ab7a38 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:19.326205 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-044f1e48-ab66-4247-97cf-8bd403ab7a38 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:19.346896 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-82e8f05a-bedc-4b1f-9b45-d47499789b6e req-31160437-e74e-48e3-8e30-16cf45c9e1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a90fed-157b-47f0-bd62-401e29342025", "tag": "7f8f5cac-5782-481c-b444-127b88873db3"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:51:19.354433 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:51:19.367643 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-82e8f05a-bedc-4b1f-9b45-d47499789b6e req-31160437-e74e-48e3-8e30-16cf45c9e1d5 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:19.367643 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-82e8f05a-bedc-4b1f-9b45-d47499789b6e req-31160437-e74e-48e3-8e30-16cf45c9e1d5 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:19.391017 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-82e8f05a-bedc-4b1f-9b45-d47499789b6e req-31160437-e74e-48e3-8e30-16cf45c9e1d5 service nova] Creating event network-changed:7f8f5cac-5782-481c-b444-127b88873db3 for instance b6a90fed-157b-47f0-bd62-401e29342025 on hv-cinder-84780 Jun 27 15:51:19.402261 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-82e8f05a-bedc-4b1f-9b45-d47499789b6e req-31160437-e74e-48e3-8e30-16cf45c9e1d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062254 Jun 27 15:51:19.403466 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 246/482] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:51:19.534579 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-044f1e48-ab66-4247-97cf-8bd403ab7a38 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:19.543387 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-044f1e48-ab66-4247-97cf-8bd403ab7a38 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:19.545003 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-044f1e48-ab66-4247-97cf-8bd403ab7a38 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:19.546589 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-044f1e48-ab66-4247-97cf-8bd403ab7a38 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1724 microversion: 2.20 time: 0.242473 Jun 27 15:51:19.547161 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 237/483] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:19 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:19.930284 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-50b34080-ed85-45e0-aee2-4f809137d681 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:19.931655 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-50b34080-ed85-45e0-aee2-4f809137d681 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:19.939595 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-50b34080-ed85-45e0-aee2-4f809137d681 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:19.940049 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-50b34080-ed85-45e0-aee2-4f809137d681 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:19.940861 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-50b34080-ed85-45e0-aee2-4f809137d681 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:19.941300 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-50b34080-ed85-45e0-aee2-4f809137d681 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:20.098444 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-50b34080-ed85-45e0-aee2-4f809137d681 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:20.107011 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-50b34080-ed85-45e0-aee2-4f809137d681 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1502 microversion: 2.1 time: 0.181568 Jun 27 15:51:20.107613 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 247/484] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:19 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:20.162368 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f0acdd9d-6c18-408b-b02d-799f8d1ca685 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:20.163032 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f0acdd9d-6c18-408b-b02d-799f8d1ca685 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:20.170084 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f0acdd9d-6c18-408b-b02d-799f8d1ca685 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:20.170531 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f0acdd9d-6c18-408b-b02d-799f8d1ca685 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:20.171591 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f0acdd9d-6c18-408b-b02d-799f8d1ca685 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:20.172007 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f0acdd9d-6c18-408b-b02d-799f8d1ca685 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:20.355984 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f0acdd9d-6c18-408b-b02d-799f8d1ca685 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:20.366643 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f0acdd9d-6c18-408b-b02d-799f8d1ca685 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 200 len: 1319 microversion: 2.1 time: 0.212224 Jun 27 15:51:20.367318 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 238/485] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:20 2022] GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:20.574734 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e103e943-fdbd-4d96-9bf3-e1db39f40abe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:20.575896 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e103e943-fdbd-4d96-9bf3-e1db39f40abe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:20.588495 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e103e943-fdbd-4d96-9bf3-e1db39f40abe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:20.589286 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e103e943-fdbd-4d96-9bf3-e1db39f40abe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:20.591044 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e103e943-fdbd-4d96-9bf3-e1db39f40abe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:20.591810 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e103e943-fdbd-4d96-9bf3-e1db39f40abe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:20.792177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e103e943-fdbd-4d96-9bf3-e1db39f40abe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:20.803025 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e103e943-fdbd-4d96-9bf3-e1db39f40abe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:20.804756 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e103e943-fdbd-4d96-9bf3-e1db39f40abe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:20.806130 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e103e943-fdbd-4d96-9bf3-e1db39f40abe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1724 microversion: 2.20 time: 0.237730 Jun 27 15:51:20.806756 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 248/486] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:20 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:21.124923 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-020b02e6-5dad-4f99-8ff0-e3c4cb98409d tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:21.125537 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-020b02e6-5dad-4f99-8ff0-e3c4cb98409d tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:21.132825 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-020b02e6-5dad-4f99-8ff0-e3c4cb98409d tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:21.133276 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-020b02e6-5dad-4f99-8ff0-e3c4cb98409d tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:21.134098 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-020b02e6-5dad-4f99-8ff0-e3c4cb98409d tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:21.134536 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-020b02e6-5dad-4f99-8ff0-e3c4cb98409d tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:21.309302 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-020b02e6-5dad-4f99-8ff0-e3c4cb98409d tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:21.323098 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-020b02e6-5dad-4f99-8ff0-e3c4cb98409d tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1502 microversion: 2.1 time: 0.202067 Jun 27 15:51:21.323940 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 239/487] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:21 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1502 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:21.389762 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f9df51a0-b18c-46d3-8335-2fe257a84cc0 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:21.390940 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f9df51a0-b18c-46d3-8335-2fe257a84cc0 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:21.403345 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f9df51a0-b18c-46d3-8335-2fe257a84cc0 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:21.404124 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f9df51a0-b18c-46d3-8335-2fe257a84cc0 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:21.405511 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f9df51a0-b18c-46d3-8335-2fe257a84cc0 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:21.406351 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f9df51a0-b18c-46d3-8335-2fe257a84cc0 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:21.669380 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f9df51a0-b18c-46d3-8335-2fe257a84cc0 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:21.678756 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f9df51a0-b18c-46d3-8335-2fe257a84cc0 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 200 len: 1319 microversion: 2.1 time: 0.296477 Jun 27 15:51:21.679407 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 249/488] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:21 2022] GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:21.826467 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3e94d478-d441-432f-868d-7372f69de714 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:21.827488 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3e94d478-d441-432f-868d-7372f69de714 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:21.833493 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3e94d478-d441-432f-868d-7372f69de714 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:21.834019 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3e94d478-d441-432f-868d-7372f69de714 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:21.834776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3e94d478-d441-432f-868d-7372f69de714 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:21.835211 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3e94d478-d441-432f-868d-7372f69de714 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:22.003498 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3e94d478-d441-432f-868d-7372f69de714 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:22.012741 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3e94d478-d441-432f-868d-7372f69de714 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:22.014345 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3e94d478-d441-432f-868d-7372f69de714 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:22.015595 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3e94d478-d441-432f-868d-7372f69de714 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1724 microversion: 2.20 time: 0.193374 Jun 27 15:51:22.016169 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 240/489] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:21 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:51:22.346825 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-fcc70cf0-804f-43dc-9ba5-d462431933ed tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:22.347837 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-fcc70cf0-804f-43dc-9ba5-d462431933ed tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:22.357282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fcc70cf0-804f-43dc-9ba5-d462431933ed tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:22.358091 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fcc70cf0-804f-43dc-9ba5-d462431933ed tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:22.360687 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fcc70cf0-804f-43dc-9ba5-d462431933ed tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:22.361942 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fcc70cf0-804f-43dc-9ba5-d462431933ed tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:22.387432 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:51:22.639092 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-fcc70cf0-804f-43dc-9ba5-d462431933ed tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c60a904281841fc8773877812f0b8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b7ceb2cdb24fe0b504de90f017ce0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:22.657690 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-fcc70cf0-804f-43dc-9ba5-d462431933ed tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 200 len: 1502 microversion: 2.1 time: 0.316599 Jun 27 15:51:22.675670 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 250/490] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:22 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 1502 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:22.698134 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-44200ddd-ee7b-4210-b3d0-1cc2d2828bb6 req-bbe3300b-0b75-492b-953f-eee008124d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6745ad45-feb1-4097-a737-47c1cd2ce6e7", "name": "network-vif-deleted", "tag": "12aaa38f-edc0-4d81-ba22-2fa2d28d2bc0"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:51:22.701170 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-9008c6ff-f2d0-475d-bc09-dd1cfb550ce7 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:22.701867 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-9008c6ff-f2d0-475d-bc09-dd1cfb550ce7 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:22.710995 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9008c6ff-f2d0-475d-bc09-dd1cfb550ce7 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:22.711452 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9008c6ff-f2d0-475d-bc09-dd1cfb550ce7 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:22.712254 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9008c6ff-f2d0-475d-bc09-dd1cfb550ce7 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:22.713072 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9008c6ff-f2d0-475d-bc09-dd1cfb550ce7 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:22.716704 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-44200ddd-ee7b-4210-b3d0-1cc2d2828bb6 req-bbe3300b-0b75-492b-953f-eee008124d02 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:22.718006 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-44200ddd-ee7b-4210-b3d0-1cc2d2828bb6 req-bbe3300b-0b75-492b-953f-eee008124d02 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:22.743705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-44200ddd-ee7b-4210-b3d0-1cc2d2828bb6 req-bbe3300b-0b75-492b-953f-eee008124d02 service nova] Creating event network-vif-deleted:12aaa38f-edc0-4d81-ba22-2fa2d28d2bc0 for instance 6745ad45-feb1-4097-a737-47c1cd2ce6e7 on hv-cinder-84780 Jun 27 15:51:22.754680 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-44200ddd-ee7b-4210-b3d0-1cc2d2828bb6 req-bbe3300b-0b75-492b-953f-eee008124d02 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063438 Jun 27 15:51:22.756113 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 241/491] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:51:22.913145 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-9008c6ff-f2d0-475d-bc09-dd1cfb550ce7 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:22.928565 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-9008c6ff-f2d0-475d-bc09-dd1cfb550ce7 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 200 len: 1508 microversion: 2.1 time: 0.235461 Jun 27 15:51:22.929163 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 251/492] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:22 2022] GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:22.948731 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-6d43880a-37b9-4608-b14e-7fc02b092034 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c01b0f13-96b2-4bba-a6f2-ac4d5e2a9df1", "device": "/dev/sdb"}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:51:22.950578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-6d43880a-37b9-4608-b14e-7fc02b092034 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:22.958888 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6d43880a-37b9-4608-b14e-7fc02b092034 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:22.959341 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6d43880a-37b9-4608-b14e-7fc02b092034 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:22.960291 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6d43880a-37b9-4608-b14e-7fc02b092034 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:22.960601 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6d43880a-37b9-4608-b14e-7fc02b092034 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:23.038902 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-93be8c90-a7a0-4abb-a35a-f05dbf35973f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:23.040844 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-93be8c90-a7a0-4abb-a35a-f05dbf35973f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:23.049021 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-93be8c90-a7a0-4abb-a35a-f05dbf35973f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:23.049520 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-93be8c90-a7a0-4abb-a35a-f05dbf35973f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:23.050357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-93be8c90-a7a0-4abb-a35a-f05dbf35973f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:23.050807 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-93be8c90-a7a0-4abb-a35a-f05dbf35973f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:23.205070 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-93be8c90-a7a0-4abb-a35a-f05dbf35973f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:23.214062 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-93be8c90-a7a0-4abb-a35a-f05dbf35973f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:23.215793 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-93be8c90-a7a0-4abb-a35a-f05dbf35973f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:23.217068 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-93be8c90-a7a0-4abb-a35a-f05dbf35973f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1724 microversion: 2.20 time: 0.183466 Jun 27 15:51:23.217671 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 252/493] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:23 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:23.508218 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-6d43880a-37b9-4608-b14e-7fc02b092034 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "POST /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.563758 Jun 27 15:51:23.508842 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 242/494] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 27 15:51:22 2022] POST /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6/os-volume_attachments => generated 194 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:51:23.680890 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-90e5f003-253f-4605-bf59-1c1a26d3fd13 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:23.681782 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-90e5f003-253f-4605-bf59-1c1a26d3fd13 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] [instance: 6745ad45-feb1-4097-a737-47c1cd2ce6e7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:23.689483 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-90e5f003-253f-4605-bf59-1c1a26d3fd13 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:23.690295 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-90e5f003-253f-4605-bf59-1c1a26d3fd13 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:23.691222 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-90e5f003-253f-4605-bf59-1c1a26d3fd13 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:23.691664 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-90e5f003-253f-4605-bf59-1c1a26d3fd13 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:23.713130 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-90e5f003-253f-4605-bf59-1c1a26d3fd13 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] HTTP exception thrown: Instance 6745ad45-feb1-4097-a737-47c1cd2ce6e7 could not be found. Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-90e5f003-253f-4605-bf59-1c1a26d3fd13 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Request method failure captured: Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 HTTP/1.1 Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudG7JE0F2arAqezeSwdMuo8kaykgVx_ZrhGSNLKPz6VtT8WxJ0QIYgY_SrA2IOlRjpCz2NXTrtNz14noJX9NFiJV2B1SXb50T00X19bKQfK4Gt_YIhVTfkGvsZPHHkO8pDClBhIR1gufgTGqfLbK_J4tMaq11_1af6Y_WJ0i12bCsDc Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 74b7ceb2cdb24fe0b504de90f017ce0f Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-VolumesActionsTest-518805029 Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:51:23.715468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:51:23.718384 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74b7ceb2cdb24fe0b504de90f017ce0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74b7ceb2cdb24fe0b504de90f017ce0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74b7ceb2cdb24fe0b504de90f017ce0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74b7ceb2cdb24fe0b504de90f017ce0f", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:51:23.718384 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-VolumesActionsTest-518805029 Jun 27 15:51:23.718384 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 74b7ceb2cdb24fe0b504de90f017ce0f Jun 27 15:51:23.718384 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-VolumesActionsTest-518805029 Jun 27 15:51:23.718384 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-VolumesActionsTest-518805029-project Jun 27 15:51:23.718384 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:51:23.718384 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:51:23.718384 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 0c60a904281841fc8773877812f0b8bc Jun 27 15:51:23.718384 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-VolumesActionsTest-518805029-project Jun 27 15:51:23.718384 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:51:23.718384 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance 6745ad45-feb1-4097-a737-47c1cd2ce6e7 could not be found. Jun 27 15:51:23.718384 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': '6745ad45-feb1-4097-a737-47c1cd2ce6e7'} Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6745ad45-feb1-4097-a737-47c1cd2ce6e7 could not be found. Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:51:23.720695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:51:23.723085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:51:23.723085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:51:23.723085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:51:23.723085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:51:23.723085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:51:23.723085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:51:23.723085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:51:23.723085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6745ad45-feb1-4097-a737-47c1cd2ce6e7 could not be found. Jun 27 15:51:23.723085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:51:23.723085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:51:23.723085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:51:23.723085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:51:23.723085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:51:23.723085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:51:23.723085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:51:23.723085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:51:23.723085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6745ad45-feb1-4097-a737-47c1cd2ce6e7 could not be found. Jun 27 15:51:23.723085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:51:23.726001 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-90e5f003-253f-4605-bf59-1c1a26d3fd13 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] Returning 404 to user: Instance 6745ad45-feb1-4097-a737-47c1cd2ce6e7 could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:51:23.726001 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-90e5f003-253f-4605-bf59-1c1a26d3fd13 tempest-VolumesActionsTest-518805029 tempest-VolumesActionsTest-518805029-project] 10.222.0.20 "GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7" status: 404 len: 111 microversion: 2.1 time: 0.040760 Jun 27 15:51:23.726001 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 253/495] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:23 2022] GET /compute/v2.1/servers/6745ad45-feb1-4097-a737-47c1cd2ce6e7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:51:24.240033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-1b9343e7-3cc8-41e3-a4da-3a8f805013ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:24.240976 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-1b9343e7-3cc8-41e3-a4da-3a8f805013ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:24.256552 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1b9343e7-3cc8-41e3-a4da-3a8f805013ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:24.257298 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1b9343e7-3cc8-41e3-a4da-3a8f805013ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:24.258305 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1b9343e7-3cc8-41e3-a4da-3a8f805013ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:24.258855 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1b9343e7-3cc8-41e3-a4da-3a8f805013ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:24.443035 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-1b9343e7-3cc8-41e3-a4da-3a8f805013ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:24.453213 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-1b9343e7-3cc8-41e3-a4da-3a8f805013ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:24.455368 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-1b9343e7-3cc8-41e3-a4da-3a8f805013ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:24.456954 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-1b9343e7-3cc8-41e3-a4da-3a8f805013ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1724 microversion: 2.20 time: 0.223399 Jun 27 15:51:24.457874 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 243/496] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:24 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:51:25.479236 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-cab3be03-76ac-40d2-9176-03473eea2893 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:25.480107 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-cab3be03-76ac-40d2-9176-03473eea2893 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:25.487720 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cab3be03-76ac-40d2-9176-03473eea2893 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:25.488171 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cab3be03-76ac-40d2-9176-03473eea2893 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:25.488960 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cab3be03-76ac-40d2-9176-03473eea2893 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:25.489404 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cab3be03-76ac-40d2-9176-03473eea2893 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:25.636289 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-cab3be03-76ac-40d2-9176-03473eea2893 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:25.645828 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-cab3be03-76ac-40d2-9176-03473eea2893 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:25.647379 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-cab3be03-76ac-40d2-9176-03473eea2893 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:25.649088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-cab3be03-76ac-40d2-9176-03473eea2893 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1724 microversion: 2.20 time: 0.174589 Jun 27 15:51:25.649769 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 254/497] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:25 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:51:26.668657 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-82d7abac-bca8-4f11-a2cb-e955551b2923 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:26.669317 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-82d7abac-bca8-4f11-a2cb-e955551b2923 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:26.677228 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-82d7abac-bca8-4f11-a2cb-e955551b2923 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:26.677709 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-82d7abac-bca8-4f11-a2cb-e955551b2923 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:26.678503 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-82d7abac-bca8-4f11-a2cb-e955551b2923 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:26.678941 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-82d7abac-bca8-4f11-a2cb-e955551b2923 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:26.887691 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-82d7abac-bca8-4f11-a2cb-e955551b2923 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:26.903999 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-82d7abac-bca8-4f11-a2cb-e955551b2923 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:26.907661 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-82d7abac-bca8-4f11-a2cb-e955551b2923 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:26.909869 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-82d7abac-bca8-4f11-a2cb-e955551b2923 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1724 microversion: 2.20 time: 0.245019 Jun 27 15:51:26.910876 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 244/498] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:26 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:27.940595 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-bf0b3ce9-031c-4d34-b618-4a9b2b208743 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:27.941235 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-bf0b3ce9-031c-4d34-b618-4a9b2b208743 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:27.948565 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bf0b3ce9-031c-4d34-b618-4a9b2b208743 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:27.949017 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bf0b3ce9-031c-4d34-b618-4a9b2b208743 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:27.949881 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bf0b3ce9-031c-4d34-b618-4a9b2b208743 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:27.950424 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bf0b3ce9-031c-4d34-b618-4a9b2b208743 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:28.105754 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-bf0b3ce9-031c-4d34-b618-4a9b2b208743 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:28.115908 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-bf0b3ce9-031c-4d34-b618-4a9b2b208743 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:28.117414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-bf0b3ce9-031c-4d34-b618-4a9b2b208743 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:28.118638 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-bf0b3ce9-031c-4d34-b618-4a9b2b208743 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1724 microversion: 2.20 time: 0.182889 Jun 27 15:51:28.119204 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 255/499] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:27 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:29.138677 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-23d251e9-ca1a-4776-af9a-1a2cdf215ee6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:29.139400 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-23d251e9-ca1a-4776-af9a-1a2cdf215ee6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:29.148207 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-23d251e9-ca1a-4776-af9a-1a2cdf215ee6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:29.148659 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-23d251e9-ca1a-4776-af9a-1a2cdf215ee6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:29.149448 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-23d251e9-ca1a-4776-af9a-1a2cdf215ee6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:29.150055 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-23d251e9-ca1a-4776-af9a-1a2cdf215ee6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:29.341571 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-23d251e9-ca1a-4776-af9a-1a2cdf215ee6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:29.351296 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-23d251e9-ca1a-4776-af9a-1a2cdf215ee6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:29.352844 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-23d251e9-ca1a-4776-af9a-1a2cdf215ee6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:29.354373 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-23d251e9-ca1a-4776-af9a-1a2cdf215ee6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1724 microversion: 2.20 time: 0.219624 Jun 27 15:51:29.354945 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 245/500] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:29 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:30.380425 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e44c2f41-464d-40d0-a300-869b1c56cded tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:30.382833 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e44c2f41-464d-40d0-a300-869b1c56cded tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:30.396532 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e44c2f41-464d-40d0-a300-869b1c56cded tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:30.398037 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e44c2f41-464d-40d0-a300-869b1c56cded tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:30.399651 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e44c2f41-464d-40d0-a300-869b1c56cded tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:30.400539 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e44c2f41-464d-40d0-a300-869b1c56cded tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:30.659798 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e44c2f41-464d-40d0-a300-869b1c56cded tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:30.689493 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e44c2f41-464d-40d0-a300-869b1c56cded tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:30.696516 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e44c2f41-464d-40d0-a300-869b1c56cded tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:30.699431 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e44c2f41-464d-40d0-a300-869b1c56cded tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1724 microversion: 2.20 time: 0.327104 Jun 27 15:51:30.705204 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 256/501] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:30 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1724 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:31.730548 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-dba535e1-b5ea-4b3b-b9b6-4021d0bf6953 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:31.733163 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-dba535e1-b5ea-4b3b-b9b6-4021d0bf6953 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:31.747337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dba535e1-b5ea-4b3b-b9b6-4021d0bf6953 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:31.748848 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dba535e1-b5ea-4b3b-b9b6-4021d0bf6953 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:31.750483 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dba535e1-b5ea-4b3b-b9b6-4021d0bf6953 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:31.751243 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dba535e1-b5ea-4b3b-b9b6-4021d0bf6953 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:32.078006 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-dba535e1-b5ea-4b3b-b9b6-4021d0bf6953 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:32.092507 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-dba535e1-b5ea-4b3b-b9b6-4021d0bf6953 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:32.096215 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-dba535e1-b5ea-4b3b-b9b6-4021d0bf6953 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:32.098340 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-dba535e1-b5ea-4b3b-b9b6-4021d0bf6953 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1724 microversion: 2.20 time: 0.375677 Jun 27 15:51:32.113084 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 246/502] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:31 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1724 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:33.126058 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-8cf848d6-06c9-4417-b5dd-ef7d69a42544 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:33.128445 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-8cf848d6-06c9-4417-b5dd-ef7d69a42544 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:33.142223 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8cf848d6-06c9-4417-b5dd-ef7d69a42544 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:33.143423 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8cf848d6-06c9-4417-b5dd-ef7d69a42544 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:33.144858 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8cf848d6-06c9-4417-b5dd-ef7d69a42544 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:33.145511 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8cf848d6-06c9-4417-b5dd-ef7d69a42544 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:33.389130 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-8cf848d6-06c9-4417-b5dd-ef7d69a42544 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:33.400858 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-8cf848d6-06c9-4417-b5dd-ef7d69a42544 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:33.403210 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-8cf848d6-06c9-4417-b5dd-ef7d69a42544 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:33.404566 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-8cf848d6-06c9-4417-b5dd-ef7d69a42544 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1724 microversion: 2.20 time: 0.286237 Jun 27 15:51:33.405125 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 257/503] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:33 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:34.435632 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-5151a697-3c0d-45cf-b64c-f82628081b0e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:34.437392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-5151a697-3c0d-45cf-b64c-f82628081b0e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:34.452871 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5151a697-3c0d-45cf-b64c-f82628081b0e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:34.454697 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5151a697-3c0d-45cf-b64c-f82628081b0e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:34.456379 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5151a697-3c0d-45cf-b64c-f82628081b0e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:34.457357 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5151a697-3c0d-45cf-b64c-f82628081b0e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:34.702731 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-5151a697-3c0d-45cf-b64c-f82628081b0e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:34.720759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-5151a697-3c0d-45cf-b64c-f82628081b0e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:34.723905 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-5151a697-3c0d-45cf-b64c-f82628081b0e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:34.726050 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-5151a697-3c0d-45cf-b64c-f82628081b0e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1724 microversion: 2.20 time: 0.296847 Jun 27 15:51:34.727038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 247/504] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:34 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:35.767115 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-7fcc394f-d991-4724-9ed5-bb0a53851e11 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:35.768350 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-7fcc394f-d991-4724-9ed5-bb0a53851e11 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:35.781025 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7fcc394f-d991-4724-9ed5-bb0a53851e11 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:35.783467 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7fcc394f-d991-4724-9ed5-bb0a53851e11 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:35.785002 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7fcc394f-d991-4724-9ed5-bb0a53851e11 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:35.785939 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7fcc394f-d991-4724-9ed5-bb0a53851e11 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:36.052651 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-7fcc394f-d991-4724-9ed5-bb0a53851e11 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:36.087433 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-7fcc394f-d991-4724-9ed5-bb0a53851e11 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:36.092002 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-7fcc394f-d991-4724-9ed5-bb0a53851e11 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:36.094980 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-7fcc394f-d991-4724-9ed5-bb0a53851e11 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1745 microversion: 2.20 time: 0.334867 Jun 27 15:51:36.096174 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 258/505] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:35 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1745 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:37.136488 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-053d35b6-d48c-49ab-8dd5-2bacbca01dc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:37.137890 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-053d35b6-d48c-49ab-8dd5-2bacbca01dc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:37.167007 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-053d35b6-d48c-49ab-8dd5-2bacbca01dc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:37.168251 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-053d35b6-d48c-49ab-8dd5-2bacbca01dc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:37.174728 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-053d35b6-d48c-49ab-8dd5-2bacbca01dc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:37.175897 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-053d35b6-d48c-49ab-8dd5-2bacbca01dc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:37.231678 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:51:37.433966 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-053d35b6-d48c-49ab-8dd5-2bacbca01dc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:37.453534 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-053d35b6-d48c-49ab-8dd5-2bacbca01dc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:37.456163 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-053d35b6-d48c-49ab-8dd5-2bacbca01dc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:37.458885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-053d35b6-d48c-49ab-8dd5-2bacbca01dc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1745 microversion: 2.20 time: 0.344952 Jun 27 15:51:37.460951 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 248/506] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:37 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1745 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:51:38.496898 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f356332c-091b-4c75-9a2c-a9864a56db2f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:38.499396 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f356332c-091b-4c75-9a2c-a9864a56db2f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:38.513617 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f356332c-091b-4c75-9a2c-a9864a56db2f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:38.514558 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f356332c-091b-4c75-9a2c-a9864a56db2f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:38.516576 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f356332c-091b-4c75-9a2c-a9864a56db2f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:38.517691 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f356332c-091b-4c75-9a2c-a9864a56db2f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:38.741494 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f356332c-091b-4c75-9a2c-a9864a56db2f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:38.757962 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f356332c-091b-4c75-9a2c-a9864a56db2f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:38.760802 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f356332c-091b-4c75-9a2c-a9864a56db2f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:38.762701 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f356332c-091b-4c75-9a2c-a9864a56db2f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1745 microversion: 2.20 time: 0.278801 Jun 27 15:51:38.763677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 259/507] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:38 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1745 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:39.787385 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-2ee0a0dc-cf31-4536-8c65-2aeeba439959 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:39.789654 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-2ee0a0dc-cf31-4536-8c65-2aeeba439959 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:39.802890 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2ee0a0dc-cf31-4536-8c65-2aeeba439959 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:39.804087 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2ee0a0dc-cf31-4536-8c65-2aeeba439959 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:39.809961 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2ee0a0dc-cf31-4536-8c65-2aeeba439959 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:39.811213 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2ee0a0dc-cf31-4536-8c65-2aeeba439959 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:40.092941 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-2ee0a0dc-cf31-4536-8c65-2aeeba439959 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:40.108774 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-2ee0a0dc-cf31-4536-8c65-2aeeba439959 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:40.112957 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-2ee0a0dc-cf31-4536-8c65-2aeeba439959 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:40.115004 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-2ee0a0dc-cf31-4536-8c65-2aeeba439959 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1745 microversion: 2.20 time: 0.335830 Jun 27 15:51:40.115831 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 249/508] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:39 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1745 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:41.148498 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-dd7784a3-8610-4fcc-a862-122cf540719c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:41.154700 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-dd7784a3-8610-4fcc-a862-122cf540719c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:41.168962 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dd7784a3-8610-4fcc-a862-122cf540719c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:41.170254 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dd7784a3-8610-4fcc-a862-122cf540719c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:41.172949 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dd7784a3-8610-4fcc-a862-122cf540719c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:41.174138 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dd7784a3-8610-4fcc-a862-122cf540719c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:41.453373 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-dd7784a3-8610-4fcc-a862-122cf540719c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:41.465471 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-dd7784a3-8610-4fcc-a862-122cf540719c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:41.467255 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-dd7784a3-8610-4fcc-a862-122cf540719c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:41.468745 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-dd7784a3-8610-4fcc-a862-122cf540719c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1740 microversion: 2.20 time: 0.330401 Jun 27 15:51:41.470518 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 260/509] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:41 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1740 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:42.496839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f1ff08eb-1e0b-4f75-a1f5-cbb8c06bf72e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:42.498391 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f1ff08eb-1e0b-4f75-a1f5-cbb8c06bf72e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:42.532382 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=50 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:51:42.535930 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f1ff08eb-1e0b-4f75-a1f5-cbb8c06bf72e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:42.536584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f1ff08eb-1e0b-4f75-a1f5-cbb8c06bf72e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:42.537576 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f1ff08eb-1e0b-4f75-a1f5-cbb8c06bf72e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:42.539028 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f1ff08eb-1e0b-4f75-a1f5-cbb8c06bf72e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:42.613245 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-fb8d55ed-9733-42d2-9f47-7d6fcf11af28 req-f24301b1-85d8-4168-af6c-12d0087efd46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9cda787-8842-478e-9fae-1c95d057875f", "name": "network-vif-plugged", "status": "completed", "tag": "cc266a26-7ff1-44ed-a332-b97209b03a63"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:51:42.634059 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-fb8d55ed-9733-42d2-9f47-7d6fcf11af28 req-f24301b1-85d8-4168-af6c-12d0087efd46 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:42.647417 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-fb8d55ed-9733-42d2-9f47-7d6fcf11af28 req-f24301b1-85d8-4168-af6c-12d0087efd46 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:42.690157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-fb8d55ed-9733-42d2-9f47-7d6fcf11af28 req-f24301b1-85d8-4168-af6c-12d0087efd46 service nova] Creating event network-vif-plugged:cc266a26-7ff1-44ed-a332-b97209b03a63 for instance b9cda787-8842-478e-9fae-1c95d057875f on hv-cinder-84780 Jun 27 15:51:42.698832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-fb8d55ed-9733-42d2-9f47-7d6fcf11af28 req-f24301b1-85d8-4168-af6c-12d0087efd46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090333 Jun 27 15:51:42.700148 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 261/510] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 27 15:51:43.021973 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f1ff08eb-1e0b-4f75-a1f5-cbb8c06bf72e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:43.038209 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f1ff08eb-1e0b-4f75-a1f5-cbb8c06bf72e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:43.041081 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f1ff08eb-1e0b-4f75-a1f5-cbb8c06bf72e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:43.044383 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f1ff08eb-1e0b-4f75-a1f5-cbb8c06bf72e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1740 microversion: 2.20 time: 0.551442 Jun 27 15:51:43.045769 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 250/511] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:42 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1740 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:44.070174 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-df3d5ac4-4e5f-4fb2-97c2-934ad5666a86 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:44.070870 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-df3d5ac4-4e5f-4fb2-97c2-934ad5666a86 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:44.091819 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-df3d5ac4-4e5f-4fb2-97c2-934ad5666a86 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:44.092260 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-df3d5ac4-4e5f-4fb2-97c2-934ad5666a86 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:44.093260 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-df3d5ac4-4e5f-4fb2-97c2-934ad5666a86 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:44.093966 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-df3d5ac4-4e5f-4fb2-97c2-934ad5666a86 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:44.440120 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-df3d5ac4-4e5f-4fb2-97c2-934ad5666a86 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:44.467449 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-df3d5ac4-4e5f-4fb2-97c2-934ad5666a86 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:44.469802 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-df3d5ac4-4e5f-4fb2-97c2-934ad5666a86 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:44.471253 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-df3d5ac4-4e5f-4fb2-97c2-934ad5666a86 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1740 microversion: 2.20 time: 0.406589 Jun 27 15:51:44.474349 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 262/512] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:44 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1740 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:51:45.369008 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9a371c70-ad77-4e64-a6fe-8f3f936d66e2 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:45.371021 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9a371c70-ad77-4e64-a6fe-8f3f936d66e2 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:45.381606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9a371c70-ad77-4e64-a6fe-8f3f936d66e2 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:45.382675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9a371c70-ad77-4e64-a6fe-8f3f936d66e2 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:45.383914 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9a371c70-ad77-4e64-a6fe-8f3f936d66e2 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:45.384683 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9a371c70-ad77-4e64-a6fe-8f3f936d66e2 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:45.504935 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-31c730bc-f3a4-42a8-87df-9f425439e634 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:45.506996 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-31c730bc-f3a4-42a8-87df-9f425439e634 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:45.515166 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-31c730bc-f3a4-42a8-87df-9f425439e634 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:45.516595 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-31c730bc-f3a4-42a8-87df-9f425439e634 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:45.518033 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-31c730bc-f3a4-42a8-87df-9f425439e634 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:45.519531 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-31c730bc-f3a4-42a8-87df-9f425439e634 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:45.582627 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-9a371c70-ad77-4e64-a6fe-8f3f936d66e2 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lazy-loading 'services' on Instance uuid adebf4df-d9bb-48ba-b742-bc579f942ad6 {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:51:45.770662 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-31c730bc-f3a4-42a8-87df-9f425439e634 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:45.780727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-31c730bc-f3a4-42a8-87df-9f425439e634 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:45.783280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-31c730bc-f3a4-42a8-87df-9f425439e634 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:45.784513 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-31c730bc-f3a4-42a8-87df-9f425439e634 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1740 microversion: 2.20 time: 0.285441 Jun 27 15:51:45.784967 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9a371c70-ad77-4e64-a6fe-8f3f936d66e2 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "DELETE /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6/os-volume_attachments/c01b0f13-96b2-4bba-a6f2-ac4d5e2a9df1" status: 202 len: 0 microversion: 2.1 time: 0.421000 Jun 27 15:51:45.787214 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 251/513] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 27 15:51:45 2022] DELETE /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6/os-volume_attachments/c01b0f13-96b2-4bba-a6f2-ac4d5e2a9df1 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:51:45.801502 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 263/514] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:45 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1740 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:51:46.817282 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8b5d34a5-ede6-430e-9c4e-f033ce7b00ee tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:46.821535 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8b5d34a5-ede6-430e-9c4e-f033ce7b00ee tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:46.834275 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8b5d34a5-ede6-430e-9c4e-f033ce7b00ee tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:46.835163 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8b5d34a5-ede6-430e-9c4e-f033ce7b00ee tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:46.836764 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8b5d34a5-ede6-430e-9c4e-f033ce7b00ee tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:46.838567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8b5d34a5-ede6-430e-9c4e-f033ce7b00ee tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:47.205897 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8b5d34a5-ede6-430e-9c4e-f033ce7b00ee tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:47.223256 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8b5d34a5-ede6-430e-9c4e-f033ce7b00ee tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:47.225169 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8b5d34a5-ede6-430e-9c4e-f033ce7b00ee tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:47.226569 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-8b5d34a5-ede6-430e-9c4e-f033ce7b00ee tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1740 microversion: 2.20 time: 0.421363 Jun 27 15:51:47.227388 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 252/515] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:46 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1740 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:48.171630 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-8890789f-748b-4541-a8db-003ee79473f2 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:48.172471 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-8890789f-748b-4541-a8db-003ee79473f2 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:48.179495 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8890789f-748b-4541-a8db-003ee79473f2 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:48.180659 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8890789f-748b-4541-a8db-003ee79473f2 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:48.182652 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8890789f-748b-4541-a8db-003ee79473f2 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:48.183688 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8890789f-748b-4541-a8db-003ee79473f2 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:48.231370 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-8890789f-748b-4541-a8db-003ee79473f2 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Going to try to terminate instance {{(pid=129473) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:51:48.250570 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-b5c126ac-621a-448c-b171-fa1074ad6506 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:48.253308 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-b5c126ac-621a-448c-b171-fa1074ad6506 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:48.271492 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b5c126ac-621a-448c-b171-fa1074ad6506 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:48.273754 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b5c126ac-621a-448c-b171-fa1074ad6506 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:48.280766 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b5c126ac-621a-448c-b171-fa1074ad6506 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:48.283283 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b5c126ac-621a-448c-b171-fa1074ad6506 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:48.400149 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-8890789f-748b-4541-a8db-003ee79473f2 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "DELETE /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 204 len: 0 microversion: 2.1 time: 0.232629 Jun 27 15:51:48.401339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 264/516] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:51:48 2022] DELETE /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:51:48.414083 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-94d79b7f-2542-476f-97bb-eed3ce301332 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:48.415502 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-94d79b7f-2542-476f-97bb-eed3ce301332 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:48.424389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-94d79b7f-2542-476f-97bb-eed3ce301332 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:48.425486 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-94d79b7f-2542-476f-97bb-eed3ce301332 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:48.426654 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-94d79b7f-2542-476f-97bb-eed3ce301332 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:48.427313 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-94d79b7f-2542-476f-97bb-eed3ce301332 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:48.647487 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b5c126ac-621a-448c-b171-fa1074ad6506 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:48.680014 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b5c126ac-621a-448c-b171-fa1074ad6506 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:48.683284 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b5c126ac-621a-448c-b171-fa1074ad6506 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:48.684894 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-b5c126ac-621a-448c-b171-fa1074ad6506 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1740 microversion: 2.20 time: 0.443910 Jun 27 15:51:48.686105 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 253/517] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:48 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1740 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:48.790614 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-94d79b7f-2542-476f-97bb-eed3ce301332 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:48.807219 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-94d79b7f-2542-476f-97bb-eed3ce301332 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 200 len: 1514 microversion: 2.1 time: 0.399670 Jun 27 15:51:48.809169 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 265/518] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:48 2022] GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 1514 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:51:49.720353 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-14426a87-e118-4121-8728-871e0036b050 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:49.721606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-14426a87-e118-4121-8728-871e0036b050 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:49.737452 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-14426a87-e118-4121-8728-871e0036b050 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:49.738722 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-14426a87-e118-4121-8728-871e0036b050 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:49.740378 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-14426a87-e118-4121-8728-871e0036b050 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:49.741423 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-14426a87-e118-4121-8728-871e0036b050 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:49.839707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3470b9d7-5200-4d55-8e57-a634cb7e8235 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:49.840804 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3470b9d7-5200-4d55-8e57-a634cb7e8235 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:49.852415 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:51:49.856409 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3470b9d7-5200-4d55-8e57-a634cb7e8235 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:49.857207 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3470b9d7-5200-4d55-8e57-a634cb7e8235 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:49.859875 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3470b9d7-5200-4d55-8e57-a634cb7e8235 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:49.860736 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3470b9d7-5200-4d55-8e57-a634cb7e8235 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:50.129509 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-14426a87-e118-4121-8728-871e0036b050 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:50.151696 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-14426a87-e118-4121-8728-871e0036b050 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:50.166440 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-14426a87-e118-4121-8728-871e0036b050 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:50.171579 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-14426a87-e118-4121-8728-871e0036b050 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1740 microversion: 2.20 time: 0.457365 Jun 27 15:51:50.185672 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3470b9d7-5200-4d55-8e57-a634cb7e8235 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:50.186667 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 254/519] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:49 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1740 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:51:50.192933 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:51:50.204385 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3470b9d7-5200-4d55-8e57-a634cb7e8235 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 200 len: 1514 microversion: 2.1 time: 0.371553 Jun 27 15:51:50.207556 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 266/520] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:49 2022] GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 1514 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:51:51.201396 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-1912da4a-9895-4dbb-a858-83883a9fd611 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:51.202697 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-1912da4a-9895-4dbb-a858-83883a9fd611 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:51.211028 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1912da4a-9895-4dbb-a858-83883a9fd611 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:51.211869 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1912da4a-9895-4dbb-a858-83883a9fd611 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:51.214101 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1912da4a-9895-4dbb-a858-83883a9fd611 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:51.215007 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1912da4a-9895-4dbb-a858-83883a9fd611 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:51.235881 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-69ac0191-9745-45ad-b975-bf807663a515 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:51.238236 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-69ac0191-9745-45ad-b975-bf807663a515 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:51.264695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-69ac0191-9745-45ad-b975-bf807663a515 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:51.266226 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-69ac0191-9745-45ad-b975-bf807663a515 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:51.268647 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-69ac0191-9745-45ad-b975-bf807663a515 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:51.270351 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-69ac0191-9745-45ad-b975-bf807663a515 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:52.241474 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-1912da4a-9895-4dbb-a858-83883a9fd611 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:52.259127 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-1912da4a-9895-4dbb-a858-83883a9fd611 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:52.262918 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-1912da4a-9895-4dbb-a858-83883a9fd611 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:52.265756 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-1912da4a-9895-4dbb-a858-83883a9fd611 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1740 microversion: 2.20 time: 1.067987 Jun 27 15:51:52.282999 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 255/521] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:51 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1740 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:52.284546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-69ac0191-9745-45ad-b975-bf807663a515 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:52.307184 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-69ac0191-9745-45ad-b975-bf807663a515 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 200 len: 1514 microversion: 2.1 time: 1.080150 Jun 27 15:51:52.323718 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 267/522] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:51 2022] GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 1514 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:51:52.996522 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-107a1050-e5ad-4eac-819c-93b3daa96b5c req-efd379c8-60c8-470b-978f-f5c61de1ad90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adebf4df-d9bb-48ba-b742-bc579f942ad6", "name": "network-vif-deleted", "tag": "ba7afe08-9a8a-4d40-bec3-4c356f065ff2"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:51:53.032065 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-107a1050-e5ad-4eac-819c-93b3daa96b5c req-efd379c8-60c8-470b-978f-f5c61de1ad90 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:53.034718 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-107a1050-e5ad-4eac-819c-93b3daa96b5c req-efd379c8-60c8-470b-978f-f5c61de1ad90 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:53.068522 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-107a1050-e5ad-4eac-819c-93b3daa96b5c req-efd379c8-60c8-470b-978f-f5c61de1ad90 service nova] Creating event network-vif-deleted:ba7afe08-9a8a-4d40-bec3-4c356f065ff2 for instance adebf4df-d9bb-48ba-b742-bc579f942ad6 on hv-cinder-84780 Jun 27 15:51:53.081621 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-107a1050-e5ad-4eac-819c-93b3daa96b5c req-efd379c8-60c8-470b-978f-f5c61de1ad90 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092860 Jun 27 15:51:53.082787 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 256/523] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:51:53.307015 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-74be0ca1-005c-4579-9366-5713eb79cdf5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:53.308171 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-74be0ca1-005c-4579-9366-5713eb79cdf5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:53.340341 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-74be0ca1-005c-4579-9366-5713eb79cdf5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:53.341723 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-74be0ca1-005c-4579-9366-5713eb79cdf5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:53.344014 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-74be0ca1-005c-4579-9366-5713eb79cdf5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:53.344666 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-74be0ca1-005c-4579-9366-5713eb79cdf5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:53.347915 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f50b37a6-3a55-45d2-8730-332070d9bb33 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:53.349484 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f50b37a6-3a55-45d2-8730-332070d9bb33 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:53.380500 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f50b37a6-3a55-45d2-8730-332070d9bb33 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:53.382680 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f50b37a6-3a55-45d2-8730-332070d9bb33 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:53.386007 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f50b37a6-3a55-45d2-8730-332070d9bb33 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:53.388213 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f50b37a6-3a55-45d2-8730-332070d9bb33 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:53.499488 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f50b37a6-3a55-45d2-8730-332070d9bb33 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:53.500946 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f50b37a6-3a55-45d2-8730-332070d9bb33 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:53.502049 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-f50b37a6-3a55-45d2-8730-332070d9bb33 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lazy-loading 'fault' on Instance uuid adebf4df-d9bb-48ba-b742-bc579f942ad6 {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:51:53.597686 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f50b37a6-3a55-45d2-8730-332070d9bb33 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7432931bd04d45bcaee686df05d5c5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e552ed97892f41259a1d7057aea64f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:53.632450 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f50b37a6-3a55-45d2-8730-332070d9bb33 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 200 len: 1309 microversion: 2.1 time: 0.300922 Jun 27 15:51:53.635646 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 257/524] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:53 2022] GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 1309 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:51:53.742456 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-74be0ca1-005c-4579-9366-5713eb79cdf5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:53.759865 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-74be0ca1-005c-4579-9366-5713eb79cdf5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:53.764143 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-74be0ca1-005c-4579-9366-5713eb79cdf5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:53.767962 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-74be0ca1-005c-4579-9366-5713eb79cdf5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1740 microversion: 2.20 time: 0.469962 Jun 27 15:51:53.786251 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 268/525] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:53 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1740 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:54.654164 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-7f4b7c0a-978b-4c77-a69e-e965f8bbf819 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:54.655280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-7f4b7c0a-978b-4c77-a69e-e965f8bbf819 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] [instance: adebf4df-d9bb-48ba-b742-bc579f942ad6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:54.667616 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7f4b7c0a-978b-4c77-a69e-e965f8bbf819 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:54.668362 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7f4b7c0a-978b-4c77-a69e-e965f8bbf819 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:54.669733 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7f4b7c0a-978b-4c77-a69e-e965f8bbf819 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:54.670492 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7f4b7c0a-978b-4c77-a69e-e965f8bbf819 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:54.691264 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-7f4b7c0a-978b-4c77-a69e-e965f8bbf819 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] HTTP exception thrown: Instance adebf4df-d9bb-48ba-b742-bc579f942ad6 could not be found. Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-7f4b7c0a-978b-4c77-a69e-e965f8bbf819 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Request method failure captured: Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 HTTP/1.1 Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudGGvcaNKNcPQGmXgdczKrEw5Ln8wRiI3Gpt4ucivFcygtPN5xdZkiRHoIC8ZbGQXRDoY1aupFuzN9NFNJWrgRIEzbszVNVux-QNPjLs31AF0qErfp16sS9TVasQuYT2mtprHwXxeDuZqu8k_2fXetlHrJiQ46K6mAiAJMEQmyXtM3w Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: e552ed97892f41259a1d7057aea64f6b Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1860429310 Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:51:54.693370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:51:54.696292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e552ed97892f41259a1d7057aea64f6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e552ed97892f41259a1d7057aea64f6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e552ed97892f41259a1d7057aea64f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e552ed97892f41259a1d7057aea64f6b", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:51:54.696292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-VolumesSnapshotTestJSON-1860429310 Jun 27 15:51:54.696292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: e552ed97892f41259a1d7057aea64f6b Jun 27 15:51:54.696292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1860429310 Jun 27 15:51:54.696292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-VolumesSnapshotTestJSON-1860429310-project Jun 27 15:51:54.696292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:51:54.696292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:51:54.696292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: 7432931bd04d45bcaee686df05d5c5b3 Jun 27 15:51:54.696292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-VolumesSnapshotTestJSON-1860429310-project Jun 27 15:51:54.696292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:51:54.696292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance adebf4df-d9bb-48ba-b742-bc579f942ad6 could not be found. Jun 27 15:51:54.696292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': 'adebf4df-d9bb-48ba-b742-bc579f942ad6'} Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adebf4df-d9bb-48ba-b742-bc579f942ad6 could not be found. Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:51:54.698046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:51:54.700514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:51:54.700514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:51:54.700514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:51:54.700514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:51:54.700514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:51:54.700514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:51:54.700514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:51:54.700514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adebf4df-d9bb-48ba-b742-bc579f942ad6 could not be found. Jun 27 15:51:54.700514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:51:54.700514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:51:54.700514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:51:54.700514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:51:54.700514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:51:54.700514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:51:54.700514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:51:54.700514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:51:54.700514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adebf4df-d9bb-48ba-b742-bc579f942ad6 could not be found. Jun 27 15:51:54.700514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:51:54.703258 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-7f4b7c0a-978b-4c77-a69e-e965f8bbf819 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] Returning 404 to user: Instance adebf4df-d9bb-48ba-b742-bc579f942ad6 could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:51:54.703258 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-7f4b7c0a-978b-4c77-a69e-e965f8bbf819 tempest-VolumesSnapshotTestJSON-1860429310 tempest-VolumesSnapshotTestJSON-1860429310-project] 10.222.0.20 "GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6" status: 404 len: 111 microversion: 2.1 time: 0.046242 Jun 27 15:51:54.703258 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 258/526] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:51:54 2022] GET /compute/v2.1/servers/adebf4df-d9bb-48ba-b742-bc579f942ad6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:51:54.798171 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a4c38f0c-f402-46cf-9c5d-854ab38b4296 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:54.798821 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a4c38f0c-f402-46cf-9c5d-854ab38b4296 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:54.815264 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a4c38f0c-f402-46cf-9c5d-854ab38b4296 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:54.815782 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a4c38f0c-f402-46cf-9c5d-854ab38b4296 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:54.816473 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a4c38f0c-f402-46cf-9c5d-854ab38b4296 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:54.817103 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a4c38f0c-f402-46cf-9c5d-854ab38b4296 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:55.079435 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a4c38f0c-f402-46cf-9c5d-854ab38b4296 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:55.100206 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a4c38f0c-f402-46cf-9c5d-854ab38b4296 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:55.105545 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a4c38f0c-f402-46cf-9c5d-854ab38b4296 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:55.124494 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a4c38f0c-f402-46cf-9c5d-854ab38b4296 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1740 microversion: 2.20 time: 0.331702 Jun 27 15:51:55.125612 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 269/527] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:54 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1740 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:51:56.148976 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-130dbbb7-ff05-440f-981a-d5f6789e39ef tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:56.150703 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-130dbbb7-ff05-440f-981a-d5f6789e39ef tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:56.160410 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-130dbbb7-ff05-440f-981a-d5f6789e39ef tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:56.161031 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-130dbbb7-ff05-440f-981a-d5f6789e39ef tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:56.162328 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-130dbbb7-ff05-440f-981a-d5f6789e39ef tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:56.163058 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-130dbbb7-ff05-440f-981a-d5f6789e39ef tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:56.330296 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-130dbbb7-ff05-440f-981a-d5f6789e39ef tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:56.342293 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-130dbbb7-ff05-440f-981a-d5f6789e39ef tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:56.344393 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-130dbbb7-ff05-440f-981a-d5f6789e39ef tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:56.345960 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-130dbbb7-ff05-440f-981a-d5f6789e39ef tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1722 microversion: 2.20 time: 0.201379 Jun 27 15:51:56.346537 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 259/528] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:56 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:57.365849 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-04cf1c09-4a34-47d8-b0ec-35e0f294c8aa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:57.366468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-04cf1c09-4a34-47d8-b0ec-35e0f294c8aa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:57.373554 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-04cf1c09-4a34-47d8-b0ec-35e0f294c8aa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:57.374237 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-04cf1c09-4a34-47d8-b0ec-35e0f294c8aa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:57.375779 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-04cf1c09-4a34-47d8-b0ec-35e0f294c8aa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:57.376309 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-04cf1c09-4a34-47d8-b0ec-35e0f294c8aa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:57.554557 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-04cf1c09-4a34-47d8-b0ec-35e0f294c8aa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:57.568372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-04cf1c09-4a34-47d8-b0ec-35e0f294c8aa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:57.570408 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-04cf1c09-4a34-47d8-b0ec-35e0f294c8aa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:57.572058 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-04cf1c09-4a34-47d8-b0ec-35e0f294c8aa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1722 microversion: 2.20 time: 0.210383 Jun 27 15:51:57.572644 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 270/529] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:57 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:58.603755 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-86f369f2-0852-40a9-84f9-ae72547c0b26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:58.605036 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-86f369f2-0852-40a9-84f9-ae72547c0b26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:58.614736 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-86f369f2-0852-40a9-84f9-ae72547c0b26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:58.615351 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-86f369f2-0852-40a9-84f9-ae72547c0b26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:58.616240 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-86f369f2-0852-40a9-84f9-ae72547c0b26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:58.616863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-86f369f2-0852-40a9-84f9-ae72547c0b26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:58.796411 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-86f369f2-0852-40a9-84f9-ae72547c0b26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:58.813898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-86f369f2-0852-40a9-84f9-ae72547c0b26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:58.817238 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-86f369f2-0852-40a9-84f9-ae72547c0b26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:51:58.819530 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-86f369f2-0852-40a9-84f9-ae72547c0b26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1722 microversion: 2.20 time: 0.221514 Jun 27 15:51:58.820585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 260/530] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:58 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:51:59.841326 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4e905dfb-33d4-4dc0-ab01-35724333a091 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:59.842079 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-4e905dfb-33d4-4dc0-ab01-35724333a091 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:59.850087 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4e905dfb-33d4-4dc0-ab01-35724333a091 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:59.850455 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4e905dfb-33d4-4dc0-ab01-35724333a091 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:59.851248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4e905dfb-33d4-4dc0-ab01-35724333a091 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:59.851684 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4e905dfb-33d4-4dc0-ab01-35724333a091 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:59.971046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-0bf5a5f6-a349-480a-91b3-f1c650293b6b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:51:59.972080 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-0bf5a5f6-a349-480a-91b3-f1c650293b6b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:51:59.982799 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0bf5a5f6-a349-480a-91b3-f1c650293b6b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:59.983540 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0bf5a5f6-a349-480a-91b3-f1c650293b6b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:51:59.985701 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0bf5a5f6-a349-480a-91b3-f1c650293b6b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:51:59.986363 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0bf5a5f6-a349-480a-91b3-f1c650293b6b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:00.036474 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4e905dfb-33d4-4dc0-ab01-35724333a091 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:00.053256 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4e905dfb-33d4-4dc0-ab01-35724333a091 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:00.056721 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4e905dfb-33d4-4dc0-ab01-35724333a091 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:00.059771 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4e905dfb-33d4-4dc0-ab01-35724333a091 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1722 microversion: 2.20 time: 0.222444 Jun 27 15:52:00.061597 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 271/531] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:51:59 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:00.106446 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-0bf5a5f6-a349-480a-91b3-f1c650293b6b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lazy-loading 'services' on Instance uuid 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:52:00.210169 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-0bf5a5f6-a349-480a-91b3-f1c650293b6b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb/os-volume_attachments/acb35c6e-5d63-46b7-9ae5-8a5a7c4637b1" status: 202 len: 0 microversion: 2.1 time: 0.246812 Jun 27 15:52:00.215796 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 261/532] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 27 15:51:59 2022] DELETE /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb/os-volume_attachments/acb35c6e-5d63-46b7-9ae5-8a5a7c4637b1 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:52:00.363828 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-a330597e-a4cf-4aaf-9139-f732862cf9a0 req-991b9e08-b391-44de-b2a2-d23a16d86d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9cda787-8842-478e-9fae-1c95d057875f", "name": "network-vif-unplugged", "status": "completed", "tag": "cc266a26-7ff1-44ed-a332-b97209b03a63"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:52:00.384076 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-a330597e-a4cf-4aaf-9139-f732862cf9a0 req-991b9e08-b391-44de-b2a2-d23a16d86d09 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:00.384904 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-a330597e-a4cf-4aaf-9139-f732862cf9a0 req-991b9e08-b391-44de-b2a2-d23a16d86d09 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:00.424601 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-a330597e-a4cf-4aaf-9139-f732862cf9a0 req-991b9e08-b391-44de-b2a2-d23a16d86d09 service nova] Creating event network-vif-unplugged:cc266a26-7ff1-44ed-a332-b97209b03a63 for instance b9cda787-8842-478e-9fae-1c95d057875f on hv-cinder-84780 Jun 27 15:52:00.428569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-a330597e-a4cf-4aaf-9139-f732862cf9a0 req-991b9e08-b391-44de-b2a2-d23a16d86d09 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072229 Jun 27 15:52:00.430961 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 272/533] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:52:01.090690 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-b89c0165-c413-44be-b7ec-b131bb5941e0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:01.091407 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-b89c0165-c413-44be-b7ec-b131bb5941e0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:01.106348 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b89c0165-c413-44be-b7ec-b131bb5941e0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:01.106824 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b89c0165-c413-44be-b7ec-b131bb5941e0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:01.107747 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b89c0165-c413-44be-b7ec-b131bb5941e0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:01.108105 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b89c0165-c413-44be-b7ec-b131bb5941e0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:01.286543 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b89c0165-c413-44be-b7ec-b131bb5941e0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:01.301780 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b89c0165-c413-44be-b7ec-b131bb5941e0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:01.303449 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b89c0165-c413-44be-b7ec-b131bb5941e0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:01.304656 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-b89c0165-c413-44be-b7ec-b131bb5941e0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1725 microversion: 2.20 time: 0.219099 Jun 27 15:52:01.305231 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 262/534] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:01 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:52:01.351861 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-34049173-e01c-40d8-a05b-472dfe6b6491 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8986610-f22b-4916-966b-5b86b8a8ff2f"}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:52:01.353906 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-34049173-e01c-40d8-a05b-472dfe6b6491 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:01.365073 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-34049173-e01c-40d8-a05b-472dfe6b6491 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:01.365762 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-34049173-e01c-40d8-a05b-472dfe6b6491 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:01.367054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-34049173-e01c-40d8-a05b-472dfe6b6491 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:01.367794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-34049173-e01c-40d8-a05b-472dfe6b6491 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:01.806662 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-34049173-e01c-40d8-a05b-472dfe6b6491 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "POST /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.473731 Jun 27 15:52:01.807690 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 273/535] 10.222.0.20 () {62 vars in 1363 bytes} [Mon Jun 27 15:52:01 2022] POST /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-volume_attachments => generated 188 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:52:02.002783 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-533984ff-fb16-4965-8fa4-db98247ef3d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:52:02.003398 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-533984ff-fb16-4965-8fa4-db98247ef3d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:02.011544 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-533984ff-fb16-4965-8fa4-db98247ef3d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:02.012067 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-533984ff-fb16-4965-8fa4-db98247ef3d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:02.013737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-533984ff-fb16-4965-8fa4-db98247ef3d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:02.014183 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-533984ff-fb16-4965-8fa4-db98247ef3d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:02.173458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:52:02.211881 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-533984ff-fb16-4965-8fa4-db98247ef3d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "POST /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/action" status: 202 len: 0 microversion: 2.20 time: 0.219618 Jun 27 15:52:02.213481 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 263/536] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jun 27 15:52:01 2022] POST /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:52:02.221524 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d40de6d9-a417-4eca-93b2-6ddf9c950e17 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:02.222761 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d40de6d9-a417-4eca-93b2-6ddf9c950e17 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:02.231240 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d40de6d9-a417-4eca-93b2-6ddf9c950e17 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:02.232408 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d40de6d9-a417-4eca-93b2-6ddf9c950e17 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:02.233844 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d40de6d9-a417-4eca-93b2-6ddf9c950e17 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:02.234808 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d40de6d9-a417-4eca-93b2-6ddf9c950e17 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:02.477467 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-346a3a2a-85d2-4193-bb3a-1f93a23053e6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:52:02.487622 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-346a3a2a-85d2-4193-bb3a-1f93a23053e6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:02.488136 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-346a3a2a-85d2-4193-bb3a-1f93a23053e6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:02.599576 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-346a3a2a-85d2-4193-bb3a-1f93a23053e6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Going to try to stop instance {{(pid=129472) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 27 15:52:02.723200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-346a3a2a-85d2-4193-bb3a-1f93a23053e6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "POST /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb/action" status: 202 len: 0 microversion: 2.1 time: 0.235427 Jun 27 15:52:02.726079 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 264/537] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 27 15:52:02 2022] POST /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:52:02.739566 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-0104d676-3dfa-4280-b80d-757ea2c260ad tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:02.740630 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-0104d676-3dfa-4280-b80d-757ea2c260ad tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:02.750698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0104d676-3dfa-4280-b80d-757ea2c260ad tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:02.751863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0104d676-3dfa-4280-b80d-757ea2c260ad tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:02.752649 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0104d676-3dfa-4280-b80d-757ea2c260ad tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:02.753213 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0104d676-3dfa-4280-b80d-757ea2c260ad tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:02.789125 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d40de6d9-a417-4eca-93b2-6ddf9c950e17 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:02.810952 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d40de6d9-a417-4eca-93b2-6ddf9c950e17 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:02.813217 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d40de6d9-a417-4eca-93b2-6ddf9c950e17 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:02.815212 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d40de6d9-a417-4eca-93b2-6ddf9c950e17 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1751 microversion: 2.20 time: 0.597417 Jun 27 15:52:02.816957 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 274/538] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:02 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1751 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:52:03.170773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0104d676-3dfa-4280-b80d-757ea2c260ad tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:03.184926 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-0104d676-3dfa-4280-b80d-757ea2c260ad tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1678 microversion: 2.1 time: 0.452810 Jun 27 15:52:03.186381 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 265/539] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:02 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1678 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:52:03.512460 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-9af38d4e-c0f9-41de-a1de-39a98c318927 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26b339e7-8845-452d-a332-c6aaba55a519"}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:52:03.514339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-9af38d4e-c0f9-41de-a1de-39a98c318927 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:03.528329 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9af38d4e-c0f9-41de-a1de-39a98c318927 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:03.529453 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9af38d4e-c0f9-41de-a1de-39a98c318927 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:03.531668 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9af38d4e-c0f9-41de-a1de-39a98c318927 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:03.532952 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9af38d4e-c0f9-41de-a1de-39a98c318927 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:03.852179 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a14468f9-5341-417c-827d-1079dba5102a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:03.852795 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a14468f9-5341-417c-827d-1079dba5102a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:03.861509 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a14468f9-5341-417c-827d-1079dba5102a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:03.862111 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a14468f9-5341-417c-827d-1079dba5102a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:03.863017 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a14468f9-5341-417c-827d-1079dba5102a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:03.863458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a14468f9-5341-417c-827d-1079dba5102a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:03.950361 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-9af38d4e-c0f9-41de-a1de-39a98c318927 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "POST /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.443222 Jun 27 15:52:03.954003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 275/540] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 27 15:52:03 2022] POST /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/os-volume_attachments => generated 194 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:52:04.134282 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a14468f9-5341-417c-827d-1079dba5102a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:04.145252 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a14468f9-5341-417c-827d-1079dba5102a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:04.147343 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a14468f9-5341-417c-827d-1079dba5102a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:04.148674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-a14468f9-5341-417c-827d-1079dba5102a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1751 microversion: 2.20 time: 0.300769 Jun 27 15:52:04.149407 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 266/541] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:03 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1751 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:04.208153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-9cc19ebb-9500-4eda-91a9-4a8cf1e6b7c9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:04.209612 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-9cc19ebb-9500-4eda-91a9-4a8cf1e6b7c9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:04.217117 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9cc19ebb-9500-4eda-91a9-4a8cf1e6b7c9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:04.217589 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9cc19ebb-9500-4eda-91a9-4a8cf1e6b7c9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:04.218439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9cc19ebb-9500-4eda-91a9-4a8cf1e6b7c9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:04.218918 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9cc19ebb-9500-4eda-91a9-4a8cf1e6b7c9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:04.379482 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-9cc19ebb-9500-4eda-91a9-4a8cf1e6b7c9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:04.388003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-9cc19ebb-9500-4eda-91a9-4a8cf1e6b7c9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1678 microversion: 2.1 time: 0.186292 Jun 27 15:52:04.388589 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 276/542] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:04 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:05.178135 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-2f890302-2e71-4e5c-90e6-675e1a63702e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:05.178928 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-2f890302-2e71-4e5c-90e6-675e1a63702e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:05.187431 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2f890302-2e71-4e5c-90e6-675e1a63702e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:05.189032 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2f890302-2e71-4e5c-90e6-675e1a63702e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:05.189991 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2f890302-2e71-4e5c-90e6-675e1a63702e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:05.190674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2f890302-2e71-4e5c-90e6-675e1a63702e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:05.371186 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-2f890302-2e71-4e5c-90e6-675e1a63702e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:05.384959 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-2f890302-2e71-4e5c-90e6-675e1a63702e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:05.387272 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-2f890302-2e71-4e5c-90e6-675e1a63702e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:05.388659 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-2f890302-2e71-4e5c-90e6-675e1a63702e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1753 microversion: 2.20 time: 0.215432 Jun 27 15:52:05.389227 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 267/543] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:05 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1753 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:05.406311 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-aa584dc9-ec9a-42b4-a271-0f3c11e571cd tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:05.407051 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-aa584dc9-ec9a-42b4-a271-0f3c11e571cd tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:05.413668 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-aa584dc9-ec9a-42b4-a271-0f3c11e571cd tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:05.414147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-aa584dc9-ec9a-42b4-a271-0f3c11e571cd tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:05.414924 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-aa584dc9-ec9a-42b4-a271-0f3c11e571cd tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:05.415358 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-aa584dc9-ec9a-42b4-a271-0f3c11e571cd tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:05.568271 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-aa584dc9-ec9a-42b4-a271-0f3c11e571cd tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:05.576787 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-aa584dc9-ec9a-42b4-a271-0f3c11e571cd tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1678 microversion: 2.1 time: 0.174879 Jun 27 15:52:05.577371 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 277/544] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:05 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:06.409336 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-b76e4d7b-eb38-4854-a437-3d29e6d9eae5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:06.409995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-b76e4d7b-eb38-4854-a437-3d29e6d9eae5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:06.417622 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b76e4d7b-eb38-4854-a437-3d29e6d9eae5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:06.418290 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b76e4d7b-eb38-4854-a437-3d29e6d9eae5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:06.419153 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b76e4d7b-eb38-4854-a437-3d29e6d9eae5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:06.419641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b76e4d7b-eb38-4854-a437-3d29e6d9eae5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:06.578000 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b76e4d7b-eb38-4854-a437-3d29e6d9eae5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:06.587444 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b76e4d7b-eb38-4854-a437-3d29e6d9eae5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:06.589030 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b76e4d7b-eb38-4854-a437-3d29e6d9eae5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:06.590281 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-b76e4d7b-eb38-4854-a437-3d29e6d9eae5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1753 microversion: 2.20 time: 0.186321 Jun 27 15:52:06.590869 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 268/545] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:06 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1753 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:06.597403 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-9af90d88-eb1a-45d8-a74e-db38e0a927f2 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:06.598323 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-9af90d88-eb1a-45d8-a74e-db38e0a927f2 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:06.605776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9af90d88-eb1a-45d8-a74e-db38e0a927f2 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:06.606229 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9af90d88-eb1a-45d8-a74e-db38e0a927f2 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:06.607020 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9af90d88-eb1a-45d8-a74e-db38e0a927f2 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:06.607454 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9af90d88-eb1a-45d8-a74e-db38e0a927f2 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:06.787211 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-9af90d88-eb1a-45d8-a74e-db38e0a927f2 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:06.796658 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-9af90d88-eb1a-45d8-a74e-db38e0a927f2 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1678 microversion: 2.1 time: 0.204051 Jun 27 15:52:06.797409 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 278/546] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:06 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:52:07.612061 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-06310cc0-04ad-4359-ba86-f1abc6add3d0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:07.613176 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-06310cc0-04ad-4359-ba86-f1abc6add3d0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:07.624084 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-06310cc0-04ad-4359-ba86-f1abc6add3d0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:07.625205 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-06310cc0-04ad-4359-ba86-f1abc6add3d0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:07.626498 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-06310cc0-04ad-4359-ba86-f1abc6add3d0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:07.627269 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-06310cc0-04ad-4359-ba86-f1abc6add3d0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:07.781002 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-06310cc0-04ad-4359-ba86-f1abc6add3d0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:07.791590 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-06310cc0-04ad-4359-ba86-f1abc6add3d0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:07.793515 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-06310cc0-04ad-4359-ba86-f1abc6add3d0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:07.794901 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-06310cc0-04ad-4359-ba86-f1abc6add3d0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1753 microversion: 2.20 time: 0.189898 Jun 27 15:52:07.795488 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 269/547] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:07 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1753 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:07.819216 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-dd821fd4-b62f-43b7-a351-d4a59a00ff6b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:07.820386 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-dd821fd4-b62f-43b7-a351-d4a59a00ff6b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:07.831777 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dd821fd4-b62f-43b7-a351-d4a59a00ff6b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:07.832314 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dd821fd4-b62f-43b7-a351-d4a59a00ff6b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:07.833162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dd821fd4-b62f-43b7-a351-d4a59a00ff6b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:07.833688 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dd821fd4-b62f-43b7-a351-d4a59a00ff6b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:07.987869 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-dd821fd4-b62f-43b7-a351-d4a59a00ff6b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:07.995780 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-dd821fd4-b62f-43b7-a351-d4a59a00ff6b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1678 microversion: 2.1 time: 0.183945 Jun 27 15:52:07.996372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 279/548] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:07 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:08.818274 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-4b244b2d-d983-4b2f-aedc-83cb962fe0a8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:08.819097 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-4b244b2d-d983-4b2f-aedc-83cb962fe0a8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:08.837037 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4b244b2d-d983-4b2f-aedc-83cb962fe0a8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:08.837756 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4b244b2d-d983-4b2f-aedc-83cb962fe0a8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:08.838943 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4b244b2d-d983-4b2f-aedc-83cb962fe0a8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:08.839884 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4b244b2d-d983-4b2f-aedc-83cb962fe0a8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:08.984537 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-4b244b2d-d983-4b2f-aedc-83cb962fe0a8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:08.999785 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-4b244b2d-d983-4b2f-aedc-83cb962fe0a8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:09.002123 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-4b244b2d-d983-4b2f-aedc-83cb962fe0a8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:09.003575 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-4b244b2d-d983-4b2f-aedc-83cb962fe0a8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1753 microversion: 2.20 time: 0.190748 Jun 27 15:52:09.004924 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 270/549] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:08 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1753 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:09.014148 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c48c4410-75d1-40da-924c-bbc40ce295c5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:09.016604 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c48c4410-75d1-40da-924c-bbc40ce295c5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:09.027979 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c48c4410-75d1-40da-924c-bbc40ce295c5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:09.028718 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c48c4410-75d1-40da-924c-bbc40ce295c5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:09.030558 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c48c4410-75d1-40da-924c-bbc40ce295c5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:09.031507 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c48c4410-75d1-40da-924c-bbc40ce295c5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:09.039498 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:52:09.192358 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-c48c4410-75d1-40da-924c-bbc40ce295c5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:09.200795 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c48c4410-75d1-40da-924c-bbc40ce295c5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1678 microversion: 2.1 time: 0.191700 Jun 27 15:52:09.201437 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 280/550] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:09 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:52:10.023419 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-bbac2244-5102-4e05-b5a7-f13a5bec63ec tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:10.024079 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-bbac2244-5102-4e05-b5a7-f13a5bec63ec tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:10.031736 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bbac2244-5102-4e05-b5a7-f13a5bec63ec tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:10.032197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bbac2244-5102-4e05-b5a7-f13a5bec63ec tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:10.032980 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bbac2244-5102-4e05-b5a7-f13a5bec63ec tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:10.033420 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bbac2244-5102-4e05-b5a7-f13a5bec63ec tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:10.197224 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-bbac2244-5102-4e05-b5a7-f13a5bec63ec tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:10.210732 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-bbac2244-5102-4e05-b5a7-f13a5bec63ec tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:10.213911 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-bbac2244-5102-4e05-b5a7-f13a5bec63ec tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:10.216350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-bbac2244-5102-4e05-b5a7-f13a5bec63ec tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1753 microversion: 2.20 time: 0.196969 Jun 27 15:52:10.217365 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 271/551] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:10 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1753 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:10.222917 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-dc14fae3-67d0-46d7-b1cb-18aa78bf4ff8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:10.223964 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-dc14fae3-67d0-46d7-b1cb-18aa78bf4ff8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:10.232129 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dc14fae3-67d0-46d7-b1cb-18aa78bf4ff8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:10.232701 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dc14fae3-67d0-46d7-b1cb-18aa78bf4ff8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:10.233710 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dc14fae3-67d0-46d7-b1cb-18aa78bf4ff8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:10.234354 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dc14fae3-67d0-46d7-b1cb-18aa78bf4ff8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:10.409686 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-dc14fae3-67d0-46d7-b1cb-18aa78bf4ff8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:10.417963 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-dc14fae3-67d0-46d7-b1cb-18aa78bf4ff8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1678 microversion: 2.1 time: 0.202290 Jun 27 15:52:10.418570 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 281/552] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:10 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1678 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:52:11.237440 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3e233a40-b416-431c-b073-c425e51ce816 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:11.238386 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3e233a40-b416-431c-b073-c425e51ce816 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:11.245472 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3e233a40-b416-431c-b073-c425e51ce816 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:11.245943 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3e233a40-b416-431c-b073-c425e51ce816 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:11.246737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3e233a40-b416-431c-b073-c425e51ce816 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:11.247168 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3e233a40-b416-431c-b073-c425e51ce816 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:11.440635 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f6c40621-32ad-4bda-ba27-70fa855f65da tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:11.441501 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f6c40621-32ad-4bda-ba27-70fa855f65da tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:11.451834 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f6c40621-32ad-4bda-ba27-70fa855f65da tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:11.452947 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f6c40621-32ad-4bda-ba27-70fa855f65da tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:11.454119 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f6c40621-32ad-4bda-ba27-70fa855f65da tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:11.454565 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f6c40621-32ad-4bda-ba27-70fa855f65da tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:11.464199 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3e233a40-b416-431c-b073-c425e51ce816 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:11.475717 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3e233a40-b416-431c-b073-c425e51ce816 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:11.477929 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3e233a40-b416-431c-b073-c425e51ce816 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:11.479551 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3e233a40-b416-431c-b073-c425e51ce816 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1753 microversion: 2.20 time: 0.247503 Jun 27 15:52:11.480430 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 272/553] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:11 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1753 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:11.662371 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f6c40621-32ad-4bda-ba27-70fa855f65da tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:11.672730 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f6c40621-32ad-4bda-ba27-70fa855f65da tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1678 microversion: 2.1 time: 0.238599 Jun 27 15:52:11.673403 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 282/554] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:11 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:52:11.681040 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-6775b727-f8c6-4b63-9af5-2af7e96850bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:52:11.682145 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-6775b727-f8c6-4b63-9af5-2af7e96850bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:11.692377 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6775b727-f8c6-4b63-9af5-2af7e96850bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:11.692824 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6775b727-f8c6-4b63-9af5-2af7e96850bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:11.693630 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6775b727-f8c6-4b63-9af5-2af7e96850bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:11.694082 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6775b727-f8c6-4b63-9af5-2af7e96850bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:11.726562 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-6775b727-f8c6-4b63-9af5-2af7e96850bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lazy-loading 'flavor' on Instance uuid 936500ce-291e-420d-be24-d5a7919350f6 {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:52:11.918795 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-6775b727-f8c6-4b63-9af5-2af7e96850bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "POST /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/action" status: 200 len: 32 microversion: 2.1 time: 0.243862 Jun 27 15:52:11.919721 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 273/555] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 27 15:52:11 2022] POST /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/action => generated 32 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 15:52:11.930167 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c66b19b8-2414-4f7b-b289-0aa44a392463 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:11.930797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c66b19b8-2414-4f7b-b289-0aa44a392463 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:11.938079 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c66b19b8-2414-4f7b-b289-0aa44a392463 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:11.938536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c66b19b8-2414-4f7b-b289-0aa44a392463 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:11.939375 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c66b19b8-2414-4f7b-b289-0aa44a392463 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:11.939819 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c66b19b8-2414-4f7b-b289-0aa44a392463 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:12.301456 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-c66b19b8-2414-4f7b-b289-0aa44a392463 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:12.318325 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c66b19b8-2414-4f7b-b289-0aa44a392463 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1734 microversion: 2.1 time: 0.391665 Jun 27 15:52:12.320415 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 283/556] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:11 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1734 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:12.508669 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-dfe2a110-8d0c-4817-9c10-01a27549b86d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:12.510305 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-dfe2a110-8d0c-4817-9c10-01a27549b86d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:12.527686 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dfe2a110-8d0c-4817-9c10-01a27549b86d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:12.528731 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dfe2a110-8d0c-4817-9c10-01a27549b86d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:12.530171 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dfe2a110-8d0c-4817-9c10-01a27549b86d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:12.531555 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dfe2a110-8d0c-4817-9c10-01a27549b86d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:12.694047 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f951fbc0-243b-4ca6-ab59-a58b42063a59 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:12.695184 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f951fbc0-243b-4ca6-ab59-a58b42063a59 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:12.717461 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f951fbc0-243b-4ca6-ab59-a58b42063a59 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:12.717461 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f951fbc0-243b-4ca6-ab59-a58b42063a59 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:12.717461 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f951fbc0-243b-4ca6-ab59-a58b42063a59 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:12.717461 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f951fbc0-243b-4ca6-ab59-a58b42063a59 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:12.739752 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-dfe2a110-8d0c-4817-9c10-01a27549b86d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:12.752960 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-dfe2a110-8d0c-4817-9c10-01a27549b86d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:12.754875 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-dfe2a110-8d0c-4817-9c10-01a27549b86d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:12.756567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-dfe2a110-8d0c-4817-9c10-01a27549b86d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1753 microversion: 2.20 time: 0.259210 Jun 27 15:52:12.757335 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 274/557] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:12 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1753 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:12.911509 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f951fbc0-243b-4ca6-ab59-a58b42063a59 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:12.925909 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f951fbc0-243b-4ca6-ab59-a58b42063a59 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1678 microversion: 2.1 time: 0.239168 Jun 27 15:52:12.927379 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 284/558] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:12 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1678 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:52:13.352412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-0fce3c92-3203-4031-998a-9dcc1af1edf7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:13.353965 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-0fce3c92-3203-4031-998a-9dcc1af1edf7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:13.365104 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=54 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:52:13.368921 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0fce3c92-3203-4031-998a-9dcc1af1edf7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:13.370380 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0fce3c92-3203-4031-998a-9dcc1af1edf7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:13.372225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0fce3c92-3203-4031-998a-9dcc1af1edf7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:13.372928 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0fce3c92-3203-4031-998a-9dcc1af1edf7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:13.600689 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0fce3c92-3203-4031-998a-9dcc1af1edf7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:13.625860 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-0fce3c92-3203-4031-998a-9dcc1af1edf7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1734 microversion: 2.1 time: 0.287545 Jun 27 15:52:13.627432 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 275/559] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:13 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1734 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:13.779736 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4b09e7bb-0402-4603-a37c-f8235128bb24 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:13.782112 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-4b09e7bb-0402-4603-a37c-f8235128bb24 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:13.791265 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4b09e7bb-0402-4603-a37c-f8235128bb24 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:13.791971 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4b09e7bb-0402-4603-a37c-f8235128bb24 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:13.792902 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4b09e7bb-0402-4603-a37c-f8235128bb24 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:13.793378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4b09e7bb-0402-4603-a37c-f8235128bb24 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:13.953986 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3bc1fabf-7402-412d-b2b6-6c8ca11e69a9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:13.955621 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3bc1fabf-7402-412d-b2b6-6c8ca11e69a9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:13.966985 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3bc1fabf-7402-412d-b2b6-6c8ca11e69a9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:13.968284 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3bc1fabf-7402-412d-b2b6-6c8ca11e69a9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:13.970319 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3bc1fabf-7402-412d-b2b6-6c8ca11e69a9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:13.971444 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3bc1fabf-7402-412d-b2b6-6c8ca11e69a9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:13.981518 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4b09e7bb-0402-4603-a37c-f8235128bb24 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:13.995064 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4b09e7bb-0402-4603-a37c-f8235128bb24 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:13.996865 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4b09e7bb-0402-4603-a37c-f8235128bb24 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:13.998403 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4b09e7bb-0402-4603-a37c-f8235128bb24 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.223842 Jun 27 15:52:14.000721 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 285/560] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:13 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:52:14.165534 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3bc1fabf-7402-412d-b2b6-6c8ca11e69a9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:14.174628 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3bc1fabf-7402-412d-b2b6-6c8ca11e69a9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1678 microversion: 2.1 time: 0.228745 Jun 27 15:52:14.175222 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 276/561] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:13 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1678 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:14.657116 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-73dd8149-03a6-48b7-bf90-3497882aa528 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:14.658314 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-73dd8149-03a6-48b7-bf90-3497882aa528 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:14.677706 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-73dd8149-03a6-48b7-bf90-3497882aa528 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:14.688484 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-73dd8149-03a6-48b7-bf90-3497882aa528 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:14.689812 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-73dd8149-03a6-48b7-bf90-3497882aa528 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:14.690561 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-73dd8149-03a6-48b7-bf90-3497882aa528 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:15.030856 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-295d560d-065d-41e9-b7fb-90e13ba6f8c6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:15.033890 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-295d560d-065d-41e9-b7fb-90e13ba6f8c6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:15.062871 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-295d560d-065d-41e9-b7fb-90e13ba6f8c6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:15.064549 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-295d560d-065d-41e9-b7fb-90e13ba6f8c6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:15.067882 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-295d560d-065d-41e9-b7fb-90e13ba6f8c6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:15.068797 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-295d560d-065d-41e9-b7fb-90e13ba6f8c6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:15.112384 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:52:15.124551 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-73dd8149-03a6-48b7-bf90-3497882aa528 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:15.157246 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-73dd8149-03a6-48b7-bf90-3497882aa528 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1734 microversion: 2.1 time: 0.505666 Jun 27 15:52:15.170875 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 286/562] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:14 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1734 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:15.199274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4e13090b-e4c9-4942-970e-2cee3bed3c5d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:15.201185 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-4e13090b-e4c9-4942-970e-2cee3bed3c5d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:15.214144 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4e13090b-e4c9-4942-970e-2cee3bed3c5d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:15.215490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4e13090b-e4c9-4942-970e-2cee3bed3c5d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:15.217437 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4e13090b-e4c9-4942-970e-2cee3bed3c5d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:15.219147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4e13090b-e4c9-4942-970e-2cee3bed3c5d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:15.418698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-295d560d-065d-41e9-b7fb-90e13ba6f8c6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:15.438388 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-295d560d-065d-41e9-b7fb-90e13ba6f8c6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:15.445546 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-295d560d-065d-41e9-b7fb-90e13ba6f8c6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:15.450259 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-295d560d-065d-41e9-b7fb-90e13ba6f8c6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.433368 Jun 27 15:52:15.456164 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 277/563] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:15 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:15.488788 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4e13090b-e4c9-4942-970e-2cee3bed3c5d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:15.498833 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4e13090b-e4c9-4942-970e-2cee3bed3c5d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1678 microversion: 2.1 time: 0.307948 Jun 27 15:52:15.509380 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 287/564] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:15 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1678 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:16.203891 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-84f437b0-512a-4983-b12c-8679798126d9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:16.205014 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-84f437b0-512a-4983-b12c-8679798126d9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:16.218215 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-84f437b0-512a-4983-b12c-8679798126d9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:16.219410 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-84f437b0-512a-4983-b12c-8679798126d9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:16.221311 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-84f437b0-512a-4983-b12c-8679798126d9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:16.222529 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-84f437b0-512a-4983-b12c-8679798126d9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:16.429258 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-84f437b0-512a-4983-b12c-8679798126d9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:16.438587 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-84f437b0-512a-4983-b12c-8679798126d9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1734 microversion: 2.1 time: 0.242652 Jun 27 15:52:16.439249 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 278/565] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:16 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1734 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:16.481542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b22526d9-fe11-4a20-bab9-fca235318bcd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:16.482778 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b22526d9-fe11-4a20-bab9-fca235318bcd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:16.497210 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b22526d9-fe11-4a20-bab9-fca235318bcd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:16.500872 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b22526d9-fe11-4a20-bab9-fca235318bcd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:16.503613 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b22526d9-fe11-4a20-bab9-fca235318bcd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:16.505586 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b22526d9-fe11-4a20-bab9-fca235318bcd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:16.532705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-46453e3e-0695-44b3-821f-2540289b9606 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:16.533692 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-46453e3e-0695-44b3-821f-2540289b9606 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:16.544114 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-46453e3e-0695-44b3-821f-2540289b9606 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:16.545913 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-46453e3e-0695-44b3-821f-2540289b9606 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:16.547892 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-46453e3e-0695-44b3-821f-2540289b9606 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:16.547892 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-46453e3e-0695-44b3-821f-2540289b9606 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:16.827504 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b22526d9-fe11-4a20-bab9-fca235318bcd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:16.850315 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b22526d9-fe11-4a20-bab9-fca235318bcd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:16.854087 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b22526d9-fe11-4a20-bab9-fca235318bcd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:16.870673 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b22526d9-fe11-4a20-bab9-fca235318bcd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.397679 Jun 27 15:52:16.871720 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 288/566] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:16 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:16.887013 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-46453e3e-0695-44b3-821f-2540289b9606 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:16.902439 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-46453e3e-0695-44b3-821f-2540289b9606 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1678 microversion: 2.1 time: 0.386260 Jun 27 15:52:16.903799 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 279/567] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:16 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1678 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:17.458390 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-355f8762-ffa2-45b9-9243-fe662ab6b14c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:17.458990 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-355f8762-ffa2-45b9-9243-fe662ab6b14c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:17.465887 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-355f8762-ffa2-45b9-9243-fe662ab6b14c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:17.466350 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-355f8762-ffa2-45b9-9243-fe662ab6b14c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:17.467180 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-355f8762-ffa2-45b9-9243-fe662ab6b14c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:17.468039 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-355f8762-ffa2-45b9-9243-fe662ab6b14c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:17.664025 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-355f8762-ffa2-45b9-9243-fe662ab6b14c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:17.682913 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-355f8762-ffa2-45b9-9243-fe662ab6b14c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1734 microversion: 2.1 time: 0.227791 Jun 27 15:52:17.684988 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 289/568] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:17 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:17.895832 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-4c86c987-1c56-48d6-a56a-65ec623f67de tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:17.897292 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-4c86c987-1c56-48d6-a56a-65ec623f67de tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:17.912085 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4c86c987-1c56-48d6-a56a-65ec623f67de tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:17.913317 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4c86c987-1c56-48d6-a56a-65ec623f67de tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:17.915312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4c86c987-1c56-48d6-a56a-65ec623f67de tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:17.916411 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4c86c987-1c56-48d6-a56a-65ec623f67de tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:17.930903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-5d9e56de-a92d-40d9-a28f-0247fbaed71a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:17.932297 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-5d9e56de-a92d-40d9-a28f-0247fbaed71a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:17.945363 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5d9e56de-a92d-40d9-a28f-0247fbaed71a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:17.946585 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5d9e56de-a92d-40d9-a28f-0247fbaed71a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:17.948325 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5d9e56de-a92d-40d9-a28f-0247fbaed71a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:17.950614 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5d9e56de-a92d-40d9-a28f-0247fbaed71a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:18.182440 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-4c86c987-1c56-48d6-a56a-65ec623f67de tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:18.199954 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-4c86c987-1c56-48d6-a56a-65ec623f67de tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:18.201549 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-4c86c987-1c56-48d6-a56a-65ec623f67de tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:18.204433 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-4c86c987-1c56-48d6-a56a-65ec623f67de tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.316232 Jun 27 15:52:18.215927 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 280/569] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:17 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:18.243280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-5d9e56de-a92d-40d9-a28f-0247fbaed71a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:18.253359 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-5d9e56de-a92d-40d9-a28f-0247fbaed71a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1678 microversion: 2.1 time: 0.328004 Jun 27 15:52:18.253989 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 290/570] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:17 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1678 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:18.710849 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-50e2fc15-e544-4789-8615-872de8224bfe tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:18.711464 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-50e2fc15-e544-4789-8615-872de8224bfe tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:18.719085 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-50e2fc15-e544-4789-8615-872de8224bfe tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:18.719564 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-50e2fc15-e544-4789-8615-872de8224bfe tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:18.720378 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-50e2fc15-e544-4789-8615-872de8224bfe tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:18.720835 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-50e2fc15-e544-4789-8615-872de8224bfe tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:18.877119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-50e2fc15-e544-4789-8615-872de8224bfe tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:18.886784 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-50e2fc15-e544-4789-8615-872de8224bfe tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1734 microversion: 2.1 time: 0.179601 Jun 27 15:52:18.887717 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 281/571] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:18 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:19.225896 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-33e6c2f3-083b-4fdc-8eab-05075e0a6aaa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:19.227312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-33e6c2f3-083b-4fdc-8eab-05075e0a6aaa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:19.237005 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-33e6c2f3-083b-4fdc-8eab-05075e0a6aaa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:19.237865 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-33e6c2f3-083b-4fdc-8eab-05075e0a6aaa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:19.239027 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-33e6c2f3-083b-4fdc-8eab-05075e0a6aaa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:19.239743 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-33e6c2f3-083b-4fdc-8eab-05075e0a6aaa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:19.280719 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-afae49a2-8ecf-476a-8500-8f323f7e252f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:19.282134 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-afae49a2-8ecf-476a-8500-8f323f7e252f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:19.291879 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-afae49a2-8ecf-476a-8500-8f323f7e252f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:19.292640 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-afae49a2-8ecf-476a-8500-8f323f7e252f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:19.293509 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-afae49a2-8ecf-476a-8500-8f323f7e252f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:19.294122 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-afae49a2-8ecf-476a-8500-8f323f7e252f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:19.521513 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-33e6c2f3-083b-4fdc-8eab-05075e0a6aaa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:19.534649 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-33e6c2f3-083b-4fdc-8eab-05075e0a6aaa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:19.536948 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-33e6c2f3-083b-4fdc-8eab-05075e0a6aaa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:19.539530 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-33e6c2f3-083b-4fdc-8eab-05075e0a6aaa tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.319072 Jun 27 15:52:19.554042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 291/572] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:19 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:19.619932 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-afae49a2-8ecf-476a-8500-8f323f7e252f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:19.635679 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-afae49a2-8ecf-476a-8500-8f323f7e252f tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1678 microversion: 2.1 time: 0.362314 Jun 27 15:52:19.641785 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 282/573] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:19 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1678 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:19.908093 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-6c600408-8366-4064-8752-80ec48f653d0 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:19.908927 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-6c600408-8366-4064-8752-80ec48f653d0 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:19.916654 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6c600408-8366-4064-8752-80ec48f653d0 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:19.917296 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6c600408-8366-4064-8752-80ec48f653d0 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:19.918496 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6c600408-8366-4064-8752-80ec48f653d0 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:19.918975 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6c600408-8366-4064-8752-80ec48f653d0 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:20.431944 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-6c600408-8366-4064-8752-80ec48f653d0 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:20.443905 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-6c600408-8366-4064-8752-80ec48f653d0 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1734 microversion: 2.1 time: 0.542962 Jun 27 15:52:20.455811 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 292/574] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:19 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1734 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:20.569465 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ed0173f3-3443-4d6c-b230-54f0be49c81c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:20.571596 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-ed0173f3-3443-4d6c-b230-54f0be49c81c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:20.586351 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ed0173f3-3443-4d6c-b230-54f0be49c81c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:20.594411 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ed0173f3-3443-4d6c-b230-54f0be49c81c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:20.597815 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ed0173f3-3443-4d6c-b230-54f0be49c81c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:20.599024 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ed0173f3-3443-4d6c-b230-54f0be49c81c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:20.656288 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a6b0b0b6-bf64-4ad4-b9fa-f8319d1d4055 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:20.657432 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a6b0b0b6-bf64-4ad4-b9fa-f8319d1d4055 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:20.659655 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=54 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:52:20.696385 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a6b0b0b6-bf64-4ad4-b9fa-f8319d1d4055 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:20.705144 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a6b0b0b6-bf64-4ad4-b9fa-f8319d1d4055 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:20.706437 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a6b0b0b6-bf64-4ad4-b9fa-f8319d1d4055 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:20.707123 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a6b0b0b6-bf64-4ad4-b9fa-f8319d1d4055 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:21.104574 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ed0173f3-3443-4d6c-b230-54f0be49c81c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:21.158232 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ed0173f3-3443-4d6c-b230-54f0be49c81c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:21.163329 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a6b0b0b6-bf64-4ad4-b9fa-f8319d1d4055 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:21.164487 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ed0173f3-3443-4d6c-b230-54f0be49c81c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:21.168632 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ed0173f3-3443-4d6c-b230-54f0be49c81c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.608821 Jun 27 15:52:21.170385 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 283/575] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:20 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:21.171712 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a6b0b0b6-bf64-4ad4-b9fa-f8319d1d4055 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1678 microversion: 2.1 time: 0.519754 Jun 27 15:52:21.172318 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 293/576] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:20 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1678 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:52:21.472505 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a4ad1f40-50c0-4db3-97d2-e311c887c2dc tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:21.475017 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a4ad1f40-50c0-4db3-97d2-e311c887c2dc tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:21.490478 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a4ad1f40-50c0-4db3-97d2-e311c887c2dc tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:21.492119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a4ad1f40-50c0-4db3-97d2-e311c887c2dc tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:21.495781 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a4ad1f40-50c0-4db3-97d2-e311c887c2dc tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:21.497175 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a4ad1f40-50c0-4db3-97d2-e311c887c2dc tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:21.766446 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a4ad1f40-50c0-4db3-97d2-e311c887c2dc tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:21.775936 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-a4ad1f40-50c0-4db3-97d2-e311c887c2dc tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1734 microversion: 2.1 time: 0.316381 Jun 27 15:52:21.776624 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 284/577] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:21 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1734 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:22.191850 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-83efafa7-6d25-4998-bd1a-3ebf9d3b74a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:22.193002 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-83efafa7-6d25-4998-bd1a-3ebf9d3b74a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:22.209428 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-84c1e18e-eb74-4194-aefa-0b1e1838b392 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:22.211599 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-84c1e18e-eb74-4194-aefa-0b1e1838b392 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:22.216957 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-83efafa7-6d25-4998-bd1a-3ebf9d3b74a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:22.220519 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-83efafa7-6d25-4998-bd1a-3ebf9d3b74a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:22.222023 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-83efafa7-6d25-4998-bd1a-3ebf9d3b74a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:22.223029 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-83efafa7-6d25-4998-bd1a-3ebf9d3b74a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:22.250678 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-84c1e18e-eb74-4194-aefa-0b1e1838b392 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:22.251915 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-84c1e18e-eb74-4194-aefa-0b1e1838b392 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:22.256260 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-84c1e18e-eb74-4194-aefa-0b1e1838b392 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:22.258934 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-84c1e18e-eb74-4194-aefa-0b1e1838b392 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:22.667187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-83efafa7-6d25-4998-bd1a-3ebf9d3b74a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:22.694592 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-83efafa7-6d25-4998-bd1a-3ebf9d3b74a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:22.697985 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-83efafa7-6d25-4998-bd1a-3ebf9d3b74a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:22.700939 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-83efafa7-6d25-4998-bd1a-3ebf9d3b74a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.512845 Jun 27 15:52:22.718771 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 294/578] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:22 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:52:22.738822 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-84c1e18e-eb74-4194-aefa-0b1e1838b392 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:22.752371 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-84c1e18e-eb74-4194-aefa-0b1e1838b392 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1678 microversion: 2.1 time: 0.552222 Jun 27 15:52:22.775046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 285/579] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:22 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1678 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:22.836079 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-8840b460-baad-4ee3-9317-4444b045d0d3 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:22.837852 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-8840b460-baad-4ee3-9317-4444b045d0d3 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:22.852930 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8840b460-baad-4ee3-9317-4444b045d0d3 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:22.854603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8840b460-baad-4ee3-9317-4444b045d0d3 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:22.856849 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8840b460-baad-4ee3-9317-4444b045d0d3 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:22.857839 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8840b460-baad-4ee3-9317-4444b045d0d3 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:23.119377 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-8840b460-baad-4ee3-9317-4444b045d0d3 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:23.133496 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-8840b460-baad-4ee3-9317-4444b045d0d3 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1734 microversion: 2.1 time: 0.319565 Jun 27 15:52:23.134858 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 295/580] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:22 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1734 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:23.738545 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-dac4f72e-fdb8-477f-a696-fe2ebe34e365 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:23.740421 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-dac4f72e-fdb8-477f-a696-fe2ebe34e365 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:23.756898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dac4f72e-fdb8-477f-a696-fe2ebe34e365 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:23.758309 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dac4f72e-fdb8-477f-a696-fe2ebe34e365 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:23.761149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dac4f72e-fdb8-477f-a696-fe2ebe34e365 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:23.762435 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dac4f72e-fdb8-477f-a696-fe2ebe34e365 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:23.779019 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-5963a2e2-f4ea-41b9-b10e-b5dc0c6fb4c5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:23.781512 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-5963a2e2-f4ea-41b9-b10e-b5dc0c6fb4c5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:23.794708 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5963a2e2-f4ea-41b9-b10e-b5dc0c6fb4c5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:23.796813 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5963a2e2-f4ea-41b9-b10e-b5dc0c6fb4c5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:23.798674 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5963a2e2-f4ea-41b9-b10e-b5dc0c6fb4c5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:23.799760 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5963a2e2-f4ea-41b9-b10e-b5dc0c6fb4c5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:24.027219 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-dac4f72e-fdb8-477f-a696-fe2ebe34e365 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:24.041078 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-dac4f72e-fdb8-477f-a696-fe2ebe34e365 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:24.042895 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-dac4f72e-fdb8-477f-a696-fe2ebe34e365 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:24.045359 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-dac4f72e-fdb8-477f-a696-fe2ebe34e365 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.316610 Jun 27 15:52:24.048050 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 286/581] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:23 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:24.112375 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-5963a2e2-f4ea-41b9-b10e-b5dc0c6fb4c5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:24.115079 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=100 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:52:24.127143 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-5963a2e2-f4ea-41b9-b10e-b5dc0c6fb4c5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1678 microversion: 2.1 time: 0.358863 Jun 27 15:52:24.128486 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 296/582] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:23 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1678 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:24.157175 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-b5163052-0c6b-4140-a322-a1a7e00a1193 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:24.157825 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-b5163052-0c6b-4140-a322-a1a7e00a1193 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:24.164940 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b5163052-0c6b-4140-a322-a1a7e00a1193 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:24.165390 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b5163052-0c6b-4140-a322-a1a7e00a1193 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:24.166227 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b5163052-0c6b-4140-a322-a1a7e00a1193 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:24.167378 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b5163052-0c6b-4140-a322-a1a7e00a1193 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:24.466875 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b5163052-0c6b-4140-a322-a1a7e00a1193 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:24.489426 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-b5163052-0c6b-4140-a322-a1a7e00a1193 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1734 microversion: 2.1 time: 0.340200 Jun 27 15:52:24.490327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 287/583] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:24 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1734 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:25.080876 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4a580859-fb4c-4b91-8201-4d9fc3656bd3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:25.081954 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-4a580859-fb4c-4b91-8201-4d9fc3656bd3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:25.092377 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4a580859-fb4c-4b91-8201-4d9fc3656bd3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:25.093109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4a580859-fb4c-4b91-8201-4d9fc3656bd3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:25.094704 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4a580859-fb4c-4b91-8201-4d9fc3656bd3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:25.095273 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4a580859-fb4c-4b91-8201-4d9fc3656bd3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:25.147614 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-111ac865-7cd2-4cfc-ad7b-8c5454d59a85 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:25.148364 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-111ac865-7cd2-4cfc-ad7b-8c5454d59a85 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:25.156856 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-111ac865-7cd2-4cfc-ad7b-8c5454d59a85 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:25.157472 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-111ac865-7cd2-4cfc-ad7b-8c5454d59a85 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:25.158533 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-111ac865-7cd2-4cfc-ad7b-8c5454d59a85 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:25.159193 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-111ac865-7cd2-4cfc-ad7b-8c5454d59a85 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:25.360894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4a580859-fb4c-4b91-8201-4d9fc3656bd3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:25.385033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-111ac865-7cd2-4cfc-ad7b-8c5454d59a85 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:25.388615 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4a580859-fb4c-4b91-8201-4d9fc3656bd3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:25.391954 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4a580859-fb4c-4b91-8201-4d9fc3656bd3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:25.393565 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4a580859-fb4c-4b91-8201-4d9fc3656bd3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.319977 Jun 27 15:52:25.394414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 297/584] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:25 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:25.404856 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-111ac865-7cd2-4cfc-ad7b-8c5454d59a85 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1678 microversion: 2.1 time: 0.262630 Jun 27 15:52:25.406336 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 288/585] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:25 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1678 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:25.520861 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-59a2eda3-dd58-499c-9c8c-b903f6f302b2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:25.521556 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-59a2eda3-dd58-499c-9c8c-b903f6f302b2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:25.529673 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-59a2eda3-dd58-499c-9c8c-b903f6f302b2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:25.530933 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-59a2eda3-dd58-499c-9c8c-b903f6f302b2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:25.532015 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-59a2eda3-dd58-499c-9c8c-b903f6f302b2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:25.532719 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-59a2eda3-dd58-499c-9c8c-b903f6f302b2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:25.743322 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-59a2eda3-dd58-499c-9c8c-b903f6f302b2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:25.752601 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-59a2eda3-dd58-499c-9c8c-b903f6f302b2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1734 microversion: 2.1 time: 0.237259 Jun 27 15:52:25.753206 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 298/586] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:25 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1734 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:26.420052 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-599b274f-4c27-46c1-bae9-cae439a35e25 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:26.422001 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-599b274f-4c27-46c1-bae9-cae439a35e25 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:26.430908 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-599b274f-4c27-46c1-bae9-cae439a35e25 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:26.431415 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-599b274f-4c27-46c1-bae9-cae439a35e25 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:26.432208 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-599b274f-4c27-46c1-bae9-cae439a35e25 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:26.432726 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-599b274f-4c27-46c1-bae9-cae439a35e25 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:26.441745 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-bdf4a925-1671-43e6-bdea-66a8315b50f8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:26.443294 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-bdf4a925-1671-43e6-bdea-66a8315b50f8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:26.459229 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bdf4a925-1671-43e6-bdea-66a8315b50f8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:26.460008 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bdf4a925-1671-43e6-bdea-66a8315b50f8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:26.461749 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bdf4a925-1671-43e6-bdea-66a8315b50f8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:26.462789 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bdf4a925-1671-43e6-bdea-66a8315b50f8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:26.871096 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-bdf4a925-1671-43e6-bdea-66a8315b50f8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:26.880600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-bdf4a925-1671-43e6-bdea-66a8315b50f8 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1678 microversion: 2.1 time: 0.451309 Jun 27 15:52:26.881529 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 299/587] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:26 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1678 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:52:26.900141 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d9e3ad69-ad82-421c-9de6-2478eae7497e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:26.901178 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d9e3ad69-ad82-421c-9de6-2478eae7497e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:26.907024 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-599b274f-4c27-46c1-bae9-cae439a35e25 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:26.918739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d9e3ad69-ad82-421c-9de6-2478eae7497e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:26.919500 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d9e3ad69-ad82-421c-9de6-2478eae7497e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:26.921628 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d9e3ad69-ad82-421c-9de6-2478eae7497e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:26.921947 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-599b274f-4c27-46c1-bae9-cae439a35e25 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:26.922955 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d9e3ad69-ad82-421c-9de6-2478eae7497e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:26.924453 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-599b274f-4c27-46c1-bae9-cae439a35e25 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:26.927002 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-599b274f-4c27-46c1-bae9-cae439a35e25 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.513080 Jun 27 15:52:26.928162 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 289/588] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:26 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:27.173303 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d9e3ad69-ad82-421c-9de6-2478eae7497e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:27.183824 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d9e3ad69-ad82-421c-9de6-2478eae7497e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1734 microversion: 2.1 time: 0.300433 Jun 27 15:52:27.194932 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 300/589] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:26 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1734 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:27.906384 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-917218df-086c-4dd8-917d-a9abb2feeedf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:27.908562 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-917218df-086c-4dd8-917d-a9abb2feeedf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:27.920325 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-917218df-086c-4dd8-917d-a9abb2feeedf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:27.921999 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-917218df-086c-4dd8-917d-a9abb2feeedf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:27.923717 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-917218df-086c-4dd8-917d-a9abb2feeedf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:27.924765 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-917218df-086c-4dd8-917d-a9abb2feeedf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:27.951739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ce22cdee-bb50-4607-a363-d364fb0d6358 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:27.955208 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-ce22cdee-bb50-4607-a363-d364fb0d6358 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:27.963047 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ce22cdee-bb50-4607-a363-d364fb0d6358 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:27.963814 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ce22cdee-bb50-4607-a363-d364fb0d6358 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:27.965814 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ce22cdee-bb50-4607-a363-d364fb0d6358 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:27.966473 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ce22cdee-bb50-4607-a363-d364fb0d6358 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:28.320400 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-917218df-086c-4dd8-917d-a9abb2feeedf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:28.338882 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-917218df-086c-4dd8-917d-a9abb2feeedf tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1655 microversion: 2.1 time: 0.439823 Jun 27 15:52:28.343840 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 290/590] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:27 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1655 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:28.349409 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-ce22cdee-bb50-4607-a363-d364fb0d6358 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:28.352697 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-5f44fbcc-16d0-4ae4-a330-0d5c6e08647c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:28.361829 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-5f44fbcc-16d0-4ae4-a330-0d5c6e08647c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:28.364099 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-ce22cdee-bb50-4607-a363-d364fb0d6358 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:28.365683 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-ce22cdee-bb50-4607-a363-d364fb0d6358 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:28.366939 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-ce22cdee-bb50-4607-a363-d364fb0d6358 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.419790 Jun 27 15:52:28.370781 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 301/591] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:27 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:52:28.372073 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5f44fbcc-16d0-4ae4-a330-0d5c6e08647c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:28.372759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5f44fbcc-16d0-4ae4-a330-0d5c6e08647c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:28.374277 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5f44fbcc-16d0-4ae4-a330-0d5c6e08647c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:28.374932 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5f44fbcc-16d0-4ae4-a330-0d5c6e08647c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:28.382960 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-46af2969-d6e9-4682-9aa1-368b1b704391 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:52:28.407544 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-46af2969-d6e9-4682-9aa1-368b1b704391 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:28.408114 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-46af2969-d6e9-4682-9aa1-368b1b704391 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:28.482947 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-46af2969-d6e9-4682-9aa1-368b1b704391 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Going to try to start instance {{(pid=129473) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 27 15:52:28.592671 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-46af2969-d6e9-4682-9aa1-368b1b704391 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "POST /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb/action" status: 202 len: 0 microversion: 2.1 time: 0.219991 Jun 27 15:52:28.593352 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 302/592] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 27 15:52:28 2022] POST /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:52:28.604113 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-aba1a342-2624-409a-a5a9-124b0e7ea308 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:28.605443 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-aba1a342-2624-409a-a5a9-124b0e7ea308 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:28.615012 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-aba1a342-2624-409a-a5a9-124b0e7ea308 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:28.616025 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-aba1a342-2624-409a-a5a9-124b0e7ea308 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:28.616994 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-aba1a342-2624-409a-a5a9-124b0e7ea308 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:28.617824 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-aba1a342-2624-409a-a5a9-124b0e7ea308 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:28.820785 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-5f44fbcc-16d0-4ae4-a330-0d5c6e08647c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:28.847058 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-5f44fbcc-16d0-4ae4-a330-0d5c6e08647c tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1734 microversion: 2.1 time: 0.500458 Jun 27 15:52:28.849090 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 291/593] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:28 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1734 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:29.145700 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-aba1a342-2624-409a-a5a9-124b0e7ea308 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:29.161878 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-aba1a342-2624-409a-a5a9-124b0e7ea308 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1664 microversion: 2.1 time: 0.563526 Jun 27 15:52:29.163206 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 303/594] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:28 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1664 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:29.401697 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-229e9d8d-ee57-4eb4-a09b-cce2cce7cd63 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:29.402304 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-229e9d8d-ee57-4eb4-a09b-cce2cce7cd63 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:29.413980 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-229e9d8d-ee57-4eb4-a09b-cce2cce7cd63 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:29.414993 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-229e9d8d-ee57-4eb4-a09b-cce2cce7cd63 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:29.416646 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-229e9d8d-ee57-4eb4-a09b-cce2cce7cd63 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:29.423678 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-229e9d8d-ee57-4eb4-a09b-cce2cce7cd63 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:29.881022 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-bd847237-b360-40be-9807-2bc5a1e30d85 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:29.882718 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-bd847237-b360-40be-9807-2bc5a1e30d85 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:29.896030 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bd847237-b360-40be-9807-2bc5a1e30d85 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:29.897754 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bd847237-b360-40be-9807-2bc5a1e30d85 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:29.899591 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bd847237-b360-40be-9807-2bc5a1e30d85 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:29.901418 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bd847237-b360-40be-9807-2bc5a1e30d85 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:30.221092 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-229e9d8d-ee57-4eb4-a09b-cce2cce7cd63 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:30.230539 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-229e9d8d-ee57-4eb4-a09b-cce2cce7cd63 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:30.231755 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-229e9d8d-ee57-4eb4-a09b-cce2cce7cd63 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:30.233669 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-229e9d8d-ee57-4eb4-a09b-cce2cce7cd63 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.835538 Jun 27 15:52:30.243333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 292/595] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:29 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:52:30.249261 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-61deb234-47c0-4568-ba93-b4ca2493229a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:30.258594 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-61deb234-47c0-4568-ba93-b4ca2493229a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:30.275635 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-61deb234-47c0-4568-ba93-b4ca2493229a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:30.276477 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-61deb234-47c0-4568-ba93-b4ca2493229a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:30.277534 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-61deb234-47c0-4568-ba93-b4ca2493229a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:30.278248 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-61deb234-47c0-4568-ba93-b4ca2493229a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:30.430014 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-bd847237-b360-40be-9807-2bc5a1e30d85 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:30.453075 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-bd847237-b360-40be-9807-2bc5a1e30d85 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1734 microversion: 2.1 time: 0.579701 Jun 27 15:52:30.463093 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 304/596] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:29 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1734 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:30.591933 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-61deb234-47c0-4568-ba93-b4ca2493229a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:30.610464 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-61deb234-47c0-4568-ba93-b4ca2493229a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1664 microversion: 2.1 time: 0.365072 Jun 27 15:52:30.612746 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 293/597] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:30 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1664 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:31.265306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-193a2269-b067-471d-b379-1141f30b6a92 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:31.266495 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-193a2269-b067-471d-b379-1141f30b6a92 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:31.278591 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-193a2269-b067-471d-b379-1141f30b6a92 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:31.279387 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-193a2269-b067-471d-b379-1141f30b6a92 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:31.281589 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-193a2269-b067-471d-b379-1141f30b6a92 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:31.282469 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-193a2269-b067-471d-b379-1141f30b6a92 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:31.472734 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d3e027e9-3b42-4682-86c2-0a4fb53a27b7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:31.473813 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d3e027e9-3b42-4682-86c2-0a4fb53a27b7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:31.481270 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d3e027e9-3b42-4682-86c2-0a4fb53a27b7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:31.482103 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d3e027e9-3b42-4682-86c2-0a4fb53a27b7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:31.483643 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d3e027e9-3b42-4682-86c2-0a4fb53a27b7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:31.485269 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d3e027e9-3b42-4682-86c2-0a4fb53a27b7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:31.496234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=100 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:52:31.570428 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-193a2269-b067-471d-b379-1141f30b6a92 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:31.597501 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-193a2269-b067-471d-b379-1141f30b6a92 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:31.603299 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-193a2269-b067-471d-b379-1141f30b6a92 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:31.605452 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-193a2269-b067-471d-b379-1141f30b6a92 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.347795 Jun 27 15:52:31.622618 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 305/598] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:31 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:31.647358 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e7cfca0c-da45-4216-ab75-90ab0ed1fdcc tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:31.649388 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e7cfca0c-da45-4216-ab75-90ab0ed1fdcc tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:31.681551 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e7cfca0c-da45-4216-ab75-90ab0ed1fdcc tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:31.682566 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e7cfca0c-da45-4216-ab75-90ab0ed1fdcc tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:31.683913 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e7cfca0c-da45-4216-ab75-90ab0ed1fdcc tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:31.684892 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e7cfca0c-da45-4216-ab75-90ab0ed1fdcc tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:31.851616 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d3e027e9-3b42-4682-86c2-0a4fb53a27b7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:31.862194 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d3e027e9-3b42-4682-86c2-0a4fb53a27b7 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1734 microversion: 2.1 time: 0.393342 Jun 27 15:52:31.863168 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 294/599] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:31 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1734 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:52:32.008602 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e7cfca0c-da45-4216-ab75-90ab0ed1fdcc tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:32.020650 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e7cfca0c-da45-4216-ab75-90ab0ed1fdcc tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1668 microversion: 2.1 time: 0.393856 Jun 27 15:52:32.021712 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 306/600] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:31 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1668 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:32.650243 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-23455fbd-2c86-4fab-b737-56c9aa0e6ee4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:32.652013 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-23455fbd-2c86-4fab-b737-56c9aa0e6ee4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:32.665370 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-23455fbd-2c86-4fab-b737-56c9aa0e6ee4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:32.666039 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-23455fbd-2c86-4fab-b737-56c9aa0e6ee4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:32.666678 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-23455fbd-2c86-4fab-b737-56c9aa0e6ee4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:32.667125 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-23455fbd-2c86-4fab-b737-56c9aa0e6ee4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:32.881531 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e2c6290d-550c-48e3-8328-26b5c6f586e3 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:32.882529 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e2c6290d-550c-48e3-8328-26b5c6f586e3 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:32.905918 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e2c6290d-550c-48e3-8328-26b5c6f586e3 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:32.907040 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e2c6290d-550c-48e3-8328-26b5c6f586e3 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:32.910483 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e2c6290d-550c-48e3-8328-26b5c6f586e3 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:32.913425 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e2c6290d-550c-48e3-8328-26b5c6f586e3 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:32.970837 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-23455fbd-2c86-4fab-b737-56c9aa0e6ee4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:33.006106 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-23455fbd-2c86-4fab-b737-56c9aa0e6ee4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:33.025535 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-23455fbd-2c86-4fab-b737-56c9aa0e6ee4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:33.033842 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-23455fbd-2c86-4fab-b737-56c9aa0e6ee4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.385256 Jun 27 15:52:33.035019 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 295/601] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:32 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:33.109427 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e2c6290d-550c-48e3-8328-26b5c6f586e3 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:33.129704 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e2c6290d-550c-48e3-8328-26b5c6f586e3 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1734 microversion: 2.1 time: 0.252540 Jun 27 15:52:33.131850 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 307/602] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:32 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1734 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:52:34.057306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-6cdcac7e-6bdf-4d82-b43b-2e3d4db78d8f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:34.060247 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-6cdcac7e-6bdf-4d82-b43b-2e3d4db78d8f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:34.076013 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6cdcac7e-6bdf-4d82-b43b-2e3d4db78d8f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:34.077695 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6cdcac7e-6bdf-4d82-b43b-2e3d4db78d8f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:34.080296 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6cdcac7e-6bdf-4d82-b43b-2e3d4db78d8f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:34.081383 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6cdcac7e-6bdf-4d82-b43b-2e3d4db78d8f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:34.184953 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-39d2ee8c-584c-4e09-b3c1-583775e80f80 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:34.186850 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-39d2ee8c-584c-4e09-b3c1-583775e80f80 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:34.228361 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-39d2ee8c-584c-4e09-b3c1-583775e80f80 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:34.240270 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-39d2ee8c-584c-4e09-b3c1-583775e80f80 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:34.242671 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-39d2ee8c-584c-4e09-b3c1-583775e80f80 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:34.246174 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-39d2ee8c-584c-4e09-b3c1-583775e80f80 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:34.531851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-6cdcac7e-6bdf-4d82-b43b-2e3d4db78d8f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:34.581691 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-6cdcac7e-6bdf-4d82-b43b-2e3d4db78d8f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:34.585756 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-6cdcac7e-6bdf-4d82-b43b-2e3d4db78d8f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:34.589168 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-6cdcac7e-6bdf-4d82-b43b-2e3d4db78d8f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.538563 Jun 27 15:52:34.606466 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 296/603] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:34 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:52:34.720710 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-39d2ee8c-584c-4e09-b3c1-583775e80f80 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:34.739920 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-39d2ee8c-584c-4e09-b3c1-583775e80f80 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1734 microversion: 2.1 time: 0.585359 Jun 27 15:52:34.740984 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 308/604] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:34 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1734 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:35.620424 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-0f817a70-8724-4818-878c-ba122eb94de1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:35.621337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-0f817a70-8724-4818-878c-ba122eb94de1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:35.633806 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0f817a70-8724-4818-878c-ba122eb94de1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:35.636873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0f817a70-8724-4818-878c-ba122eb94de1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:35.639541 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0f817a70-8724-4818-878c-ba122eb94de1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:35.641202 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0f817a70-8724-4818-878c-ba122eb94de1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:35.760418 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-7d88682d-904a-4e0c-b234-acec90fbb069 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:35.761669 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-7d88682d-904a-4e0c-b234-acec90fbb069 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:35.774724 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7d88682d-904a-4e0c-b234-acec90fbb069 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:35.777660 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7d88682d-904a-4e0c-b234-acec90fbb069 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:35.778733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7d88682d-904a-4e0c-b234-acec90fbb069 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:35.779349 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7d88682d-904a-4e0c-b234-acec90fbb069 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:35.996563 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0f817a70-8724-4818-878c-ba122eb94de1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:36.008882 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0f817a70-8724-4818-878c-ba122eb94de1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:36.012946 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0f817a70-8724-4818-878c-ba122eb94de1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:36.015238 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-0f817a70-8724-4818-878c-ba122eb94de1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.398753 Jun 27 15:52:36.028542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 297/605] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:35 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:36.049518 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-7d88682d-904a-4e0c-b234-acec90fbb069 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:36.067421 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-7d88682d-904a-4e0c-b234-acec90fbb069 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1714 microversion: 2.1 time: 0.310575 Jun 27 15:52:36.069042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 309/606] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:35 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1714 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:52:36.244285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c6e00576-efe4-4e9e-b23f-02aa2bcbd619 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:36.245126 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c6e00576-efe4-4e9e-b23f-02aa2bcbd619 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:36.254953 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c6e00576-efe4-4e9e-b23f-02aa2bcbd619 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:36.265909 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c6e00576-efe4-4e9e-b23f-02aa2bcbd619 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:36.267599 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c6e00576-efe4-4e9e-b23f-02aa2bcbd619 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:36.268222 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c6e00576-efe4-4e9e-b23f-02aa2bcbd619 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:36.459147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-c6e00576-efe4-4e9e-b23f-02aa2bcbd619 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] HTTP exception thrown: Cannot 'detach_volume' instance 936500ce-291e-420d-be24-d5a7919350f6 while it is in vm_state rescued Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c6e00576-efe4-4e9e-b23f-02aa2bcbd619 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Request method failure captured: Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: DELETE /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/os-volume_attachments/26b339e7-8845-452d-a332-c6aaba55a519 HTTP/1.1 Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudE47SqYCXFSdwZD2N57kXyxbMrtAm6wX1EHtWWUQlN--Jwn5T-qbUh8GEOB_fIgz7HnxVWw5uliaKnGFA9JAZI-vk9FE28h8V1LQOmG3Cr5YsOFNKtSr0bpkyXAEDcif6-AZEMpUP4PExRgpVR393bo3hncJYpBO41EPMQZDXHDQyI Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: f5e448e724fa479ea693168592686391 Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-852477413 Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:52:36.466166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:52:36.469383 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5e448e724fa479ea693168592686391"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5e448e724fa479ea693168592686391"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5e448e724fa479ea693168592686391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5e448e724fa479ea693168592686391", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:52:36.469383 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-ServerRescueNegativeTestJSON-852477413 Jun 27 15:52:36.469383 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: f5e448e724fa479ea693168592686391 Jun 27 15:52:36.469383 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-852477413 Jun 27 15:52:36.469383 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-ServerRescueNegativeTestJSON-852477413-project Jun 27 15:52:36.469383 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:52:36.469383 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:52:36.469383 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: 1a7a81da8acf40849a9ea86e2542ae6a Jun 27 15:52:36.469383 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-ServerRescueNegativeTestJSON-852477413-project Jun 27 15:52:36.469383 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:52:36.469383 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Cannot 'detach_volume' instance 936500ce-291e-420d-be24-d5a7919350f6 while it is in vm_state rescued Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'server_id': '936500ce-291e-420d-be24-d5a7919350f6', 'id': '26b339e7-8845-452d-a332-c6aaba55a519'} Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 936500ce-291e-420d-be24-d5a7919350f6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:52:36.470737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:52:36.473119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 27 15:52:36.473119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 27 15:52:36.473119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 27 15:52:36.473119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 27 15:52:36.473119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 936500ce-291e-420d-be24-d5a7919350f6 while it is in vm_state rescued Jun 27 15:52:36.473119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:52:36.473119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:52:36.473119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:52:36.473119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:52:36.473119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:52:36.473119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:52:36.473119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:52:36.473119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:52:36.473119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 936500ce-291e-420d-be24-d5a7919350f6 while it is in vm_state rescued Jun 27 15:52:36.473119 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:52:36.481154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c6e00576-efe4-4e9e-b23f-02aa2bcbd619 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Returning 409 to user: Cannot 'detach_volume' instance 936500ce-291e-420d-be24-d5a7919350f6 while it is in vm_state rescued {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:52:36.481154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c6e00576-efe4-4e9e-b23f-02aa2bcbd619 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "DELETE /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/os-volume_attachments/26b339e7-8845-452d-a332-c6aaba55a519" status: 409 len: 152 microversion: 2.1 time: 0.239119 Jun 27 15:52:36.481154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 298/607] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 27 15:52:36 2022] DELETE /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/os-volume_attachments/26b339e7-8845-452d-a332-c6aaba55a519 => generated 152 bytes in 241 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 27 15:52:36.494816 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-76c5198d-86c4-460d-8654-670fc7964cb4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:52:36.500389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-76c5198d-86c4-460d-8654-670fc7964cb4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:36.531512 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-76c5198d-86c4-460d-8654-670fc7964cb4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:36.536367 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-76c5198d-86c4-460d-8654-670fc7964cb4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:36.539130 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-76c5198d-86c4-460d-8654-670fc7964cb4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:36.540928 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-76c5198d-86c4-460d-8654-670fc7964cb4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:36.774894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-76c5198d-86c4-460d-8654-670fc7964cb4 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "POST /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/action" status: 202 len: 0 microversion: 2.1 time: 0.282100 Jun 27 15:52:36.779065 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 310/608] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 27 15:52:36 2022] POST /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:52:36.792647 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-dce9856b-3d6c-4b56-9531-d4d436e75e69 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:36.798222 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-dce9856b-3d6c-4b56-9531-d4d436e75e69 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:36.818261 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dce9856b-3d6c-4b56-9531-d4d436e75e69 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:36.819712 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dce9856b-3d6c-4b56-9531-d4d436e75e69 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:36.821709 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dce9856b-3d6c-4b56-9531-d4d436e75e69 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:36.822909 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dce9856b-3d6c-4b56-9531-d4d436e75e69 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:37.057409 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-53334017-b6c6-43c7-9752-f964dce8c262 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:37.059993 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-53334017-b6c6-43c7-9752-f964dce8c262 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:37.108773 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-53334017-b6c6-43c7-9752-f964dce8c262 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:37.110417 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-53334017-b6c6-43c7-9752-f964dce8c262 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:37.112317 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-53334017-b6c6-43c7-9752-f964dce8c262 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:37.115335 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-53334017-b6c6-43c7-9752-f964dce8c262 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:37.196778 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:52:37.546477 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-dce9856b-3d6c-4b56-9531-d4d436e75e69 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:37.590343 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-dce9856b-3d6c-4b56-9531-d4d436e75e69 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1722 microversion: 2.1 time: 0.792584 Jun 27 15:52:37.607150 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 299/609] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:36 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1722 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:37.746424 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-53334017-b6c6-43c7-9752-f964dce8c262 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:37.782227 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-53334017-b6c6-43c7-9752-f964dce8c262 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:37.787986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-53334017-b6c6-43c7-9752-f964dce8c262 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:37.793091 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-53334017-b6c6-43c7-9752-f964dce8c262 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.760517 Jun 27 15:52:37.797103 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 311/610] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:37 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:52:38.625234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ce0d50b1-3c1c-4c98-8437-22289cce299d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:38.627307 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-ce0d50b1-3c1c-4c98-8437-22289cce299d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:38.651479 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ce0d50b1-3c1c-4c98-8437-22289cce299d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:38.659159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ce0d50b1-3c1c-4c98-8437-22289cce299d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:38.660874 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ce0d50b1-3c1c-4c98-8437-22289cce299d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:38.662032 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ce0d50b1-3c1c-4c98-8437-22289cce299d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:38.850605 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-dbe7683e-04c7-4cfd-9c1a-b75d6d1ed624 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:38.858529 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-dbe7683e-04c7-4cfd-9c1a-b75d6d1ed624 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:38.882307 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dbe7683e-04c7-4cfd-9c1a-b75d6d1ed624 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:38.884393 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dbe7683e-04c7-4cfd-9c1a-b75d6d1ed624 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:38.887592 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dbe7683e-04c7-4cfd-9c1a-b75d6d1ed624 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:38.888186 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dbe7683e-04c7-4cfd-9c1a-b75d6d1ed624 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:39.521492 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ce0d50b1-3c1c-4c98-8437-22289cce299d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:39.536994 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ce0d50b1-3c1c-4c98-8437-22289cce299d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1722 microversion: 2.1 time: 0.919300 Jun 27 15:52:39.537604 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 300/611] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:38 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1722 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:39.550565 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-dbe7683e-04c7-4cfd-9c1a-b75d6d1ed624 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:39.572898 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-dbe7683e-04c7-4cfd-9c1a-b75d6d1ed624 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:39.578097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-dbe7683e-04c7-4cfd-9c1a-b75d6d1ed624 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:39.581392 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-dbe7683e-04c7-4cfd-9c1a-b75d6d1ed624 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.750363 Jun 27 15:52:39.583260 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 312/612] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:38 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:52:40.556676 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-655f2d27-4f4a-4062-ba97-14d87d44d2f9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:40.557472 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-655f2d27-4f4a-4062-ba97-14d87d44d2f9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:40.575757 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-655f2d27-4f4a-4062-ba97-14d87d44d2f9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:40.576309 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-655f2d27-4f4a-4062-ba97-14d87d44d2f9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:40.577673 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-655f2d27-4f4a-4062-ba97-14d87d44d2f9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:40.578250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-655f2d27-4f4a-4062-ba97-14d87d44d2f9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:40.603478 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-11d0e956-c14a-40b2-bd26-8df23f74b467 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:40.604341 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-11d0e956-c14a-40b2-bd26-8df23f74b467 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:40.621137 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-11d0e956-c14a-40b2-bd26-8df23f74b467 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:40.623572 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-11d0e956-c14a-40b2-bd26-8df23f74b467 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:40.627145 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-11d0e956-c14a-40b2-bd26-8df23f74b467 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:40.629296 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-11d0e956-c14a-40b2-bd26-8df23f74b467 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:41.038727 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-655f2d27-4f4a-4062-ba97-14d87d44d2f9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:41.046523 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-11d0e956-c14a-40b2-bd26-8df23f74b467 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:41.049557 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-655f2d27-4f4a-4062-ba97-14d87d44d2f9 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1728 microversion: 2.1 time: 0.496595 Jun 27 15:52:41.062739 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 301/613] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:40 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1728 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:41.069088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-130fae19-77c3-4e39-a000-370c16003ab0 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:41.069356 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-11d0e956-c14a-40b2-bd26-8df23f74b467 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:41.070063 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-130fae19-77c3-4e39-a000-370c16003ab0 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:41.071790 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-11d0e956-c14a-40b2-bd26-8df23f74b467 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:41.073267 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-11d0e956-c14a-40b2-bd26-8df23f74b467 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.475251 Jun 27 15:52:41.074362 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 313/614] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:40 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:41.103736 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-130fae19-77c3-4e39-a000-370c16003ab0 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:41.104187 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-130fae19-77c3-4e39-a000-370c16003ab0 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:41.104983 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-130fae19-77c3-4e39-a000-370c16003ab0 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:41.105418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-130fae19-77c3-4e39-a000-370c16003ab0 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:41.201236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-130fae19-77c3-4e39-a000-370c16003ab0 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137044 Jun 27 15:52:41.202126 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 302/615] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jun 27 15:52:41 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:52:41.604133 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-1623c70d-a938-46ef-a1e3-1cce0b942754 req-81adc0c3-a271-46dc-a78c-bfb30278243f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9cda787-8842-478e-9fae-1c95d057875f", "name": "network-vif-plugged", "status": "completed", "tag": "cc266a26-7ff1-44ed-a332-b97209b03a63"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:52:41.675875 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-1623c70d-a938-46ef-a1e3-1cce0b942754 req-81adc0c3-a271-46dc-a78c-bfb30278243f service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:41.677218 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-1623c70d-a938-46ef-a1e3-1cce0b942754 req-81adc0c3-a271-46dc-a78c-bfb30278243f service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:41.739380 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-1623c70d-a938-46ef-a1e3-1cce0b942754 req-81adc0c3-a271-46dc-a78c-bfb30278243f service nova] Creating event network-vif-plugged:cc266a26-7ff1-44ed-a332-b97209b03a63 for instance b9cda787-8842-478e-9fae-1c95d057875f on hv-cinder-84780 Jun 27 15:52:41.756986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-1623c70d-a938-46ef-a1e3-1cce0b942754 req-81adc0c3-a271-46dc-a78c-bfb30278243f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172865 Jun 27 15:52:41.759070 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 314/616] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:52:42.094137 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-0dbfdaf1-cc48-4ee4-b625-253a2e970ecd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:42.096346 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-0dbfdaf1-cc48-4ee4-b625-253a2e970ecd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:42.119852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0dbfdaf1-cc48-4ee4-b625-253a2e970ecd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:42.121378 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0dbfdaf1-cc48-4ee4-b625-253a2e970ecd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:42.122524 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0dbfdaf1-cc48-4ee4-b625-253a2e970ecd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:42.123764 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0dbfdaf1-cc48-4ee4-b625-253a2e970ecd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:42.728751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0dbfdaf1-cc48-4ee4-b625-253a2e970ecd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:42.739502 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0dbfdaf1-cc48-4ee4-b625-253a2e970ecd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:42.741064 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0dbfdaf1-cc48-4ee4-b625-253a2e970ecd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:42.749115 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-0dbfdaf1-cc48-4ee4-b625-253a2e970ecd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.659881 Jun 27 15:52:42.749754 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 303/617] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:42 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:52:43.411931 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-63501aa5-e924-4c96-a4cc-221fe96ae9e2 req-7f5569fc-cce5-4b55-b33d-80b53ae649b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "936500ce-291e-420d-be24-d5a7919350f6", "tag": "df282c39-1e8b-43bd-9dde-0ce20496061e"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:52:43.436408 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-63501aa5-e924-4c96-a4cc-221fe96ae9e2 req-7f5569fc-cce5-4b55-b33d-80b53ae649b5 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:43.436866 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-63501aa5-e924-4c96-a4cc-221fe96ae9e2 req-7f5569fc-cce5-4b55-b33d-80b53ae649b5 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:43.465331 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-63501aa5-e924-4c96-a4cc-221fe96ae9e2 req-7f5569fc-cce5-4b55-b33d-80b53ae649b5 service nova] Creating event network-changed:df282c39-1e8b-43bd-9dde-0ce20496061e for instance 936500ce-291e-420d-be24-d5a7919350f6 on hv-cinder-84780 Jun 27 15:52:43.481320 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-63501aa5-e924-4c96-a4cc-221fe96ae9e2 req-7f5569fc-cce5-4b55-b33d-80b53ae649b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074709 Jun 27 15:52:43.481972 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 315/618] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:52:43.774305 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d22857be-b493-4a37-a54c-c5c14469c2a5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:43.775418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d22857be-b493-4a37-a54c-c5c14469c2a5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:43.784027 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=58 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:52:43.795852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d22857be-b493-4a37-a54c-c5c14469c2a5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:43.797412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d22857be-b493-4a37-a54c-c5c14469c2a5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:43.809007 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d22857be-b493-4a37-a54c-c5c14469c2a5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:43.810279 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d22857be-b493-4a37-a54c-c5c14469c2a5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:44.156892 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d22857be-b493-4a37-a54c-c5c14469c2a5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:44.169279 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d22857be-b493-4a37-a54c-c5c14469c2a5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:44.171791 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d22857be-b493-4a37-a54c-c5c14469c2a5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:44.173073 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d22857be-b493-4a37-a54c-c5c14469c2a5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.406659 Jun 27 15:52:44.188493 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 304/619] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:43 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:45.210638 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-9b7dcc18-0016-40e5-a30a-66efd9d133c4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:45.210638 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-9b7dcc18-0016-40e5-a30a-66efd9d133c4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:45.219502 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9b7dcc18-0016-40e5-a30a-66efd9d133c4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:45.221845 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9b7dcc18-0016-40e5-a30a-66efd9d133c4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:45.222847 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9b7dcc18-0016-40e5-a30a-66efd9d133c4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:45.223439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9b7dcc18-0016-40e5-a30a-66efd9d133c4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:45.540276 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-f6ca16f2-48be-459b-a4df-58032ccbac95 req-edfdec2a-f4a6-4ede-8dd7-e929be42c143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "936500ce-291e-420d-be24-d5a7919350f6", "tag": "df282c39-1e8b-43bd-9dde-0ce20496061e"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:52:45.572631 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-f6ca16f2-48be-459b-a4df-58032ccbac95 req-edfdec2a-f4a6-4ede-8dd7-e929be42c143 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:45.574608 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-f6ca16f2-48be-459b-a4df-58032ccbac95 req-edfdec2a-f4a6-4ede-8dd7-e929be42c143 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:45.583710 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-9b7dcc18-0016-40e5-a30a-66efd9d133c4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:45.611062 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-9b7dcc18-0016-40e5-a30a-66efd9d133c4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:45.619620 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-f6ca16f2-48be-459b-a4df-58032ccbac95 req-edfdec2a-f4a6-4ede-8dd7-e929be42c143 service nova] Creating event network-changed:df282c39-1e8b-43bd-9dde-0ce20496061e for instance 936500ce-291e-420d-be24-d5a7919350f6 on hv-cinder-84780 Jun 27 15:52:45.622302 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-9b7dcc18-0016-40e5-a30a-66efd9d133c4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:45.626187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-9b7dcc18-0016-40e5-a30a-66efd9d133c4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1809 microversion: 2.20 time: 0.432861 Jun 27 15:52:45.629150 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 316/620] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:45 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1809 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:45.645864 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-f6ca16f2-48be-459b-a4df-58032ccbac95 req-edfdec2a-f4a6-4ede-8dd7-e929be42c143 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119735 Jun 27 15:52:45.649413 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 305/621] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:52:46.646485 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-caf94f17-db2f-4adf-bde4-7d24097db835 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:46.647111 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-caf94f17-db2f-4adf-bde4-7d24097db835 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:46.667432 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-caf94f17-db2f-4adf-bde4-7d24097db835 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:46.670272 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-caf94f17-db2f-4adf-bde4-7d24097db835 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:46.672498 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-caf94f17-db2f-4adf-bde4-7d24097db835 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:46.674207 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-caf94f17-db2f-4adf-bde4-7d24097db835 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:46.943048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-caf94f17-db2f-4adf-bde4-7d24097db835 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:46.955966 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-caf94f17-db2f-4adf-bde4-7d24097db835 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:46.969384 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-caf94f17-db2f-4adf-bde4-7d24097db835 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:46.976659 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-caf94f17-db2f-4adf-bde4-7d24097db835 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1796 microversion: 2.20 time: 0.335462 Jun 27 15:52:46.981093 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 317/622] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:52:46 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1796 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:52:56.855946 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=3 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:52:56.856700 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=64 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:52:56.862014 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-91bb1126-910f-4646-9ba3-aa8f91f58cf5 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Action: 'create', calling method: .version_select at 0x7fe145c47040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1556187232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrH4ddwqUSJNG434nfSs1x6ROqfZ7jN0NzI5es8oMOWHleakVwnNmKMbbS8N5Tjlwdn8qX9cSV7Zg6ITSBuPQC4ILXViY3kXi7iZ//1q5ZmD44Gpsp/kTz2G6rH6R6KLA=="}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:52:56.879057 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-91bb1126-910f-4646-9ba3-aa8f91f58cf5 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Getting quotas for project 6a070d552fee4594bbcf0ae7adc16f94. Resources: {'key_pairs'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:52:56.883712 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-91bb1126-910f-4646-9ba3-aa8f91f58cf5 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Getting quotas for user 1320328d4bd04dc28c0c828a0f30e641 and project 6a070d552fee4594bbcf0ae7adc16f94. Resources: {'key_pairs'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:52:56.910582 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-91bb1126-910f-4646-9ba3-aa8f91f58cf5 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056127 Jun 27 15:52:56.911348 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 306/623] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 27 15:52:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:52:57.038988 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-99c716d7-eefd-4670-8b4b-3e4f687b6dcc tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-9342159", "imageRef": "8b10106f-09aa-46b9-a857-6c0274b0669e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1556187232", "networks": [{"uuid": "eb09ca6b-3dbe-4ec1-a7f5-caf0c1889211"}]}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:52:57.047190 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=49 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:52:57.047874 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=31 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:52:57.332706 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.network.neutron [None req-99c716d7-eefd-4670-8b4b-3e4f687b6dcc tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] validate_networks() for [('eb09ca6b-3dbe-4ec1-a7f5-caf0c1889211', None, None, None, None, None)] {{(pid=129473) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:52:57.846084 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-99c716d7-eefd-4670-8b4b-3e4f687b6dcc tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Flavor limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:52:57.846890 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-99c716d7-eefd-4670-8b4b-3e4f687b6dcc tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Image limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:52:57.847985 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-99c716d7-eefd-4670-8b4b-3e4f687b6dcc tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Flavor pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:52:57.848717 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-99c716d7-eefd-4670-8b4b-3e4f687b6dcc tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Image pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:52:57.849462 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-99c716d7-eefd-4670-8b4b-3e4f687b6dcc tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:52:57.866286 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-99c716d7-eefd-4670-8b4b-3e4f687b6dcc tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:57.867007 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-99c716d7-eefd-4670-8b4b-3e4f687b6dcc tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:57.868294 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-99c716d7-eefd-4670-8b4b-3e4f687b6dcc tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:57.868999 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-99c716d7-eefd-4670-8b4b-3e4f687b6dcc tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:57.903275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-99c716d7-eefd-4670-8b4b-3e4f687b6dcc tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Getting quotas for project 6a070d552fee4594bbcf0ae7adc16f94. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:52:57.913168 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-99c716d7-eefd-4670-8b4b-3e4f687b6dcc tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Getting quotas for user 1320328d4bd04dc28c0c828a0f30e641 and project 6a070d552fee4594bbcf0ae7adc16f94. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:52:57.933375 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-99c716d7-eefd-4670-8b4b-3e4f687b6dcc tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Going to run 1 instances... {{(pid=129473) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:52:57.936921 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-99c716d7-eefd-4670-8b4b-3e4f687b6dcc tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b10106f-09aa-46b9-a857-6c0274b0669e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:52:57.994776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-99c716d7-eefd-4670-8b4b-3e4f687b6dcc tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.959687 Jun 27 15:52:57.995450 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 318/624] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 15:52:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:52:58.007089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-bc375367-635f-4de0-ad06-53e7a8071a82 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:58.007882 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-bc375367-635f-4de0-ad06-53e7a8071a82 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:58.258394 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-bc375367-635f-4de0-ad06-53e7a8071a82 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:58.269538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-bc375367-635f-4de0-ad06-53e7a8071a82 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1256 microversion: 2.1 time: 0.266659 Jun 27 15:52:58.270493 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 307/625] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:58 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1256 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:59.291658 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f6721aa1-4892-4f82-a1c6-5cede8476df9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:52:59.292626 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f6721aa1-4892-4f82-a1c6-5cede8476df9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:52:59.303106 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f6721aa1-4892-4f82-a1c6-5cede8476df9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:59.303742 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f6721aa1-4892-4f82-a1c6-5cede8476df9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:59.304745 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f6721aa1-4892-4f82-a1c6-5cede8476df9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:52:59.305448 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f6721aa1-4892-4f82-a1c6-5cede8476df9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:52:59.402135 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f6721aa1-4892-4f82-a1c6-5cede8476df9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:52:59.416281 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f6721aa1-4892-4f82-a1c6-5cede8476df9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1308 microversion: 2.1 time: 0.130366 Jun 27 15:52:59.417323 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 319/626] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:52:59 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1308 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:52:59.700275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:52:59.701097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Mon Jun 27 15:52:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 15:53:00.443363 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f9495c0f-eba0-4dec-bb1a-2c331fbafd75 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:00.445049 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f9495c0f-eba0-4dec-bb1a-2c331fbafd75 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:00.456668 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f9495c0f-eba0-4dec-bb1a-2c331fbafd75 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:00.463025 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f9495c0f-eba0-4dec-bb1a-2c331fbafd75 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:00.464143 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f9495c0f-eba0-4dec-bb1a-2c331fbafd75 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:00.464946 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f9495c0f-eba0-4dec-bb1a-2c331fbafd75 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:00.871162 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f9495c0f-eba0-4dec-bb1a-2c331fbafd75 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:00.890612 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f9495c0f-eba0-4dec-bb1a-2c331fbafd75 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1356 microversion: 2.1 time: 0.450767 Jun 27 15:53:00.892475 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 308/627] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:00 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1356 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:01.932660 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-562f9163-3eeb-4a1e-bd8f-74369e9a27c2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:01.936393 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-562f9163-3eeb-4a1e-bd8f-74369e9a27c2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:01.956793 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-562f9163-3eeb-4a1e-bd8f-74369e9a27c2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:01.958249 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-562f9163-3eeb-4a1e-bd8f-74369e9a27c2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:01.963965 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-562f9163-3eeb-4a1e-bd8f-74369e9a27c2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:01.972051 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-562f9163-3eeb-4a1e-bd8f-74369e9a27c2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:02.196805 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-562f9163-3eeb-4a1e-bd8f-74369e9a27c2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:02.207721 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-c09793f9-daf4-4118-8488-ba13299369da req-ddc19ed4-f4a0-413f-96c4-86299c060942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d5e0c6-2148-42b6-80f2-8c86f7d62e34", "tag": "f3f58277-1227-4989-91cb-3c2473267d77"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:02.214424 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-562f9163-3eeb-4a1e-bd8f-74369e9a27c2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1356 microversion: 2.1 time: 0.297768 Jun 27 15:53:02.227407 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 320/628] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:01 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1356 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:02.250419 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-c09793f9-daf4-4118-8488-ba13299369da req-ddc19ed4-f4a0-413f-96c4-86299c060942 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:02.251559 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-c09793f9-daf4-4118-8488-ba13299369da req-ddc19ed4-f4a0-413f-96c4-86299c060942 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:02.286705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-c09793f9-daf4-4118-8488-ba13299369da req-ddc19ed4-f4a0-413f-96c4-86299c060942 service nova] Creating event network-changed:f3f58277-1227-4989-91cb-3c2473267d77 for instance 04d5e0c6-2148-42b6-80f2-8c86f7d62e34 on hv-cinder-84780 Jun 27 15:53:02.296821 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-c09793f9-daf4-4118-8488-ba13299369da req-ddc19ed4-f4a0-413f-96c4-86299c060942 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097296 Jun 27 15:53:02.298325 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 309/629] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:53:03.238694 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3af49a34-61f9-4a53-b84b-6a7d5f074047 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:03.240783 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3af49a34-61f9-4a53-b84b-6a7d5f074047 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:03.253743 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3af49a34-61f9-4a53-b84b-6a7d5f074047 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:03.254543 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3af49a34-61f9-4a53-b84b-6a7d5f074047 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:03.255922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3af49a34-61f9-4a53-b84b-6a7d5f074047 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:03.256694 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3af49a34-61f9-4a53-b84b-6a7d5f074047 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:03.443355 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3af49a34-61f9-4a53-b84b-6a7d5f074047 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:03.459768 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3af49a34-61f9-4a53-b84b-6a7d5f074047 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1356 microversion: 2.1 time: 0.229308 Jun 27 15:53:03.460875 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 321/630] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:03 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1356 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:04.480140 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-4e107c4f-1dc0-4931-958e-73e6a488ebff tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:04.481298 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-4e107c4f-1dc0-4931-958e-73e6a488ebff tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:04.490226 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4e107c4f-1dc0-4931-958e-73e6a488ebff tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:04.490811 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4e107c4f-1dc0-4931-958e-73e6a488ebff tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:04.491691 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4e107c4f-1dc0-4931-958e-73e6a488ebff tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:04.492229 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4e107c4f-1dc0-4931-958e-73e6a488ebff tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:04.712774 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-4e107c4f-1dc0-4931-958e-73e6a488ebff tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:04.721029 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-4e107c4f-1dc0-4931-958e-73e6a488ebff tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1356 microversion: 2.1 time: 0.246113 Jun 27 15:53:04.721653 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 310/631] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:04 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1356 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:05.750775 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0e634d16-f349-4a03-b626-7c8bba06e704 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:05.752911 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-0e634d16-f349-4a03-b626-7c8bba06e704 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:05.761626 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0e634d16-f349-4a03-b626-7c8bba06e704 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:05.762511 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0e634d16-f349-4a03-b626-7c8bba06e704 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:05.763935 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0e634d16-f349-4a03-b626-7c8bba06e704 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:05.764405 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0e634d16-f349-4a03-b626-7c8bba06e704 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:06.017347 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-0e634d16-f349-4a03-b626-7c8bba06e704 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:06.032966 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-0e634d16-f349-4a03-b626-7c8bba06e704 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1356 microversion: 2.1 time: 0.289601 Jun 27 15:53:06.033988 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 322/632] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:05 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1356 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:07.064168 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-542d5b40-ee1c-431b-80be-effa2b29b023 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:07.065320 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-542d5b40-ee1c-431b-80be-effa2b29b023 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:07.075232 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-542d5b40-ee1c-431b-80be-effa2b29b023 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:07.076875 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-542d5b40-ee1c-431b-80be-effa2b29b023 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:07.078902 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-542d5b40-ee1c-431b-80be-effa2b29b023 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:07.079914 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-542d5b40-ee1c-431b-80be-effa2b29b023 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:07.288642 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-542d5b40-ee1c-431b-80be-effa2b29b023 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:07.303356 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-542d5b40-ee1c-431b-80be-effa2b29b023 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1356 microversion: 2.1 time: 0.247493 Jun 27 15:53:07.304211 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 311/633] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:07 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1356 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:08.322169 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-7c15b386-2215-4d65-9148-1fa61739eaf9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:08.323074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-7c15b386-2215-4d65-9148-1fa61739eaf9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:08.326058 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=2 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:53:08.327505 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=6 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:53:08.335214 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7c15b386-2215-4d65-9148-1fa61739eaf9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:08.335816 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7c15b386-2215-4d65-9148-1fa61739eaf9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:08.336643 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7c15b386-2215-4d65-9148-1fa61739eaf9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:08.337089 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7c15b386-2215-4d65-9148-1fa61739eaf9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:08.530234 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-7c15b386-2215-4d65-9148-1fa61739eaf9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:08.544015 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-7c15b386-2215-4d65-9148-1fa61739eaf9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1356 microversion: 2.1 time: 0.225737 Jun 27 15:53:08.545721 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 323/634] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:08 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1356 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:09.566708 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c072b76c-6620-4e0b-a879-adf8dd206a1c tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:09.567346 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c072b76c-6620-4e0b-a879-adf8dd206a1c tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:09.569933 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=6 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:53:09.579810 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c072b76c-6620-4e0b-a879-adf8dd206a1c tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:09.580278 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c072b76c-6620-4e0b-a879-adf8dd206a1c tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:09.581057 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c072b76c-6620-4e0b-a879-adf8dd206a1c tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:09.581657 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c072b76c-6620-4e0b-a879-adf8dd206a1c tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:09.729477 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-c072b76c-6620-4e0b-a879-adf8dd206a1c tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:09.737740 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c072b76c-6620-4e0b-a879-adf8dd206a1c tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1356 microversion: 2.1 time: 0.175023 Jun 27 15:53:09.738339 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 312/635] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:09 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1356 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:10.760839 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-96eb4413-52f6-43d4-931b-e4ba0fb7eb34 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:10.762050 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-96eb4413-52f6-43d4-931b-e4ba0fb7eb34 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:10.774855 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-96eb4413-52f6-43d4-931b-e4ba0fb7eb34 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:10.775640 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-96eb4413-52f6-43d4-931b-e4ba0fb7eb34 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:10.776993 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-96eb4413-52f6-43d4-931b-e4ba0fb7eb34 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:10.777831 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-96eb4413-52f6-43d4-931b-e4ba0fb7eb34 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:10.815201 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-0e7df4dd-d7de-45d6-a7e1-26d1317349f0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:10.816174 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-0e7df4dd-d7de-45d6-a7e1-26d1317349f0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:10.829329 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0e7df4dd-d7de-45d6-a7e1-26d1317349f0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:10.829914 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0e7df4dd-d7de-45d6-a7e1-26d1317349f0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:10.831021 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0e7df4dd-d7de-45d6-a7e1-26d1317349f0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:10.831544 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0e7df4dd-d7de-45d6-a7e1-26d1317349f0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:10.875727 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-0e7df4dd-d7de-45d6-a7e1-26d1317349f0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069077 Jun 27 15:53:10.876333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 313/636] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 27 15:53:10 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 15:53:10.956470 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9d72a0aa-01f9-4362-bda0-eb782b407e17 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:10.957440 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9d72a0aa-01f9-4362-bda0-eb782b407e17 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:10.967212 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9d72a0aa-01f9-4362-bda0-eb782b407e17 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:10.967684 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9d72a0aa-01f9-4362-bda0-eb782b407e17 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:10.968547 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9d72a0aa-01f9-4362-bda0-eb782b407e17 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:10.969000 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9d72a0aa-01f9-4362-bda0-eb782b407e17 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:10.999749 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9d72a0aa-01f9-4362-bda0-eb782b407e17 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Going to try to terminate instance {{(pid=129472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:53:11.013471 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-96eb4413-52f6-43d4-931b-e4ba0fb7eb34 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:11.023396 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-96eb4413-52f6-43d4-931b-e4ba0fb7eb34 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1356 microversion: 2.1 time: 0.269955 Jun 27 15:53:11.024122 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 324/637] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:10 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1356 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:11.100604 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9d72a0aa-01f9-4362-bda0-eb782b407e17 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 204 len: 0 microversion: 2.1 time: 0.149163 Jun 27 15:53:11.101444 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 314/638] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:53:10 2022] DELETE /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:53:11.113118 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-61127de0-3087-485a-98c3-31ed791f2622 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:11.113781 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-61127de0-3087-485a-98c3-31ed791f2622 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:11.120427 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-61127de0-3087-485a-98c3-31ed791f2622 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:11.120877 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-61127de0-3087-485a-98c3-31ed791f2622 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:11.121669 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-61127de0-3087-485a-98c3-31ed791f2622 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:11.123306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-61127de0-3087-485a-98c3-31ed791f2622 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:11.302478 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-61127de0-3087-485a-98c3-31ed791f2622 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:11.311833 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-61127de0-3087-485a-98c3-31ed791f2622 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1674 microversion: 2.1 time: 0.202563 Jun 27 15:53:11.312522 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 325/639] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:11 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1674 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:12.050896 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-46456e07-5421-4df2-99d5-d5dea22323aa tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:12.052202 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-46456e07-5421-4df2-99d5-d5dea22323aa tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:12.061725 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-46456e07-5421-4df2-99d5-d5dea22323aa tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:12.062183 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-46456e07-5421-4df2-99d5-d5dea22323aa tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:12.062983 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-46456e07-5421-4df2-99d5-d5dea22323aa tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:12.063417 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-46456e07-5421-4df2-99d5-d5dea22323aa tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:12.230429 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-46456e07-5421-4df2-99d5-d5dea22323aa tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:12.240673 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-46456e07-5421-4df2-99d5-d5dea22323aa tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1356 microversion: 2.1 time: 0.196365 Jun 27 15:53:12.242285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 315/640] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:12 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1356 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:12.338296 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-8424e878-81c2-47e7-8a83-c905866f9d2d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:12.338943 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-8424e878-81c2-47e7-8a83-c905866f9d2d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:12.346089 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8424e878-81c2-47e7-8a83-c905866f9d2d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:12.346544 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8424e878-81c2-47e7-8a83-c905866f9d2d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:12.347341 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8424e878-81c2-47e7-8a83-c905866f9d2d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:12.347781 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8424e878-81c2-47e7-8a83-c905866f9d2d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:12.541897 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-8424e878-81c2-47e7-8a83-c905866f9d2d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:12.551722 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-8424e878-81c2-47e7-8a83-c905866f9d2d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1674 microversion: 2.1 time: 0.217258 Jun 27 15:53:12.552440 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 326/641] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:12 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1674 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:13.267551 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-bb51bdaa-8700-487c-9c17-cfcd7e26b9b0 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:13.268214 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-bb51bdaa-8700-487c-9c17-cfcd7e26b9b0 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:13.275318 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bb51bdaa-8700-487c-9c17-cfcd7e26b9b0 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:13.275775 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bb51bdaa-8700-487c-9c17-cfcd7e26b9b0 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:13.276565 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bb51bdaa-8700-487c-9c17-cfcd7e26b9b0 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:13.277004 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bb51bdaa-8700-487c-9c17-cfcd7e26b9b0 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:13.433120 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-bb51bdaa-8700-487c-9c17-cfcd7e26b9b0 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:13.447853 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-bb51bdaa-8700-487c-9c17-cfcd7e26b9b0 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1356 microversion: 2.1 time: 0.184473 Jun 27 15:53:13.448936 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 316/642] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:13 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1356 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:13.573860 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a11497e5-7053-49c5-ad56-4e05cbed16cd tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:13.574495 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a11497e5-7053-49c5-ad56-4e05cbed16cd tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:13.584341 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a11497e5-7053-49c5-ad56-4e05cbed16cd tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:13.584823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a11497e5-7053-49c5-ad56-4e05cbed16cd tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:13.585674 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a11497e5-7053-49c5-ad56-4e05cbed16cd tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:13.586137 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a11497e5-7053-49c5-ad56-4e05cbed16cd tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:13.737705 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a11497e5-7053-49c5-ad56-4e05cbed16cd tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:13.745571 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a11497e5-7053-49c5-ad56-4e05cbed16cd tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1674 microversion: 2.1 time: 0.176602 Jun 27 15:53:13.746202 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 327/643] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:13 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:14.465356 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-172faddd-3058-4557-887a-112de8eeb1f5 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:14.467266 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-172faddd-3058-4557-887a-112de8eeb1f5 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:14.474772 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-172faddd-3058-4557-887a-112de8eeb1f5 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:14.475212 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-172faddd-3058-4557-887a-112de8eeb1f5 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:14.475991 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-172faddd-3058-4557-887a-112de8eeb1f5 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:14.476423 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-172faddd-3058-4557-887a-112de8eeb1f5 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:14.660779 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-172faddd-3058-4557-887a-112de8eeb1f5 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:14.676532 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-172faddd-3058-4557-887a-112de8eeb1f5 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1356 microversion: 2.1 time: 0.214923 Jun 27 15:53:14.678096 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 317/644] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:14 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1356 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:14.781789 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e0f97d9d-8f17-4914-b8ea-5f569ef637fe tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:14.782833 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e0f97d9d-8f17-4914-b8ea-5f569ef637fe tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:14.792127 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e0f97d9d-8f17-4914-b8ea-5f569ef637fe tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:14.792616 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e0f97d9d-8f17-4914-b8ea-5f569ef637fe tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:14.793606 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e0f97d9d-8f17-4914-b8ea-5f569ef637fe tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:14.794948 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e0f97d9d-8f17-4914-b8ea-5f569ef637fe tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:14.935253 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e0f97d9d-8f17-4914-b8ea-5f569ef637fe tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:14.944886 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e0f97d9d-8f17-4914-b8ea-5f569ef637fe tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 200 len: 1607 microversion: 2.1 time: 0.175429 Jun 27 15:53:14.946403 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 328/645] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:14 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 1607 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:15.189602 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-37dec035-fab4-4bcf-a0e8-99cd321976fb req-a2a1f4f8-a95b-48a4-8549-861c37d075f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1e27a3-c6e6-42ec-9a80-fa6806324aeb", "name": "network-vif-deleted", "tag": "b6437b54-dcf4-4813-87ad-d62ddc232007"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:15.199111 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-37dec035-fab4-4bcf-a0e8-99cd321976fb req-a2a1f4f8-a95b-48a4-8549-861c37d075f8 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:15.199567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-37dec035-fab4-4bcf-a0e8-99cd321976fb req-a2a1f4f8-a95b-48a4-8549-861c37d075f8 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:15.213139 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-37dec035-fab4-4bcf-a0e8-99cd321976fb req-a2a1f4f8-a95b-48a4-8549-861c37d075f8 service nova] Creating event network-vif-deleted:b6437b54-dcf4-4813-87ad-d62ddc232007 for instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb on hv-cinder-84780 Jun 27 15:53:15.219735 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-37dec035-fab4-4bcf-a0e8-99cd321976fb req-a2a1f4f8-a95b-48a4-8549-861c37d075f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033646 Jun 27 15:53:15.221107 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 318/646] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:53:15.699200 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-85fcc55c-ff7a-4df8-a36c-0e40a741d2d7 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:15.700536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-85fcc55c-ff7a-4df8-a36c-0e40a741d2d7 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:15.708270 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-85fcc55c-ff7a-4df8-a36c-0e40a741d2d7 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:15.708789 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-85fcc55c-ff7a-4df8-a36c-0e40a741d2d7 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:15.709600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-85fcc55c-ff7a-4df8-a36c-0e40a741d2d7 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:15.710183 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-85fcc55c-ff7a-4df8-a36c-0e40a741d2d7 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:15.913425 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-85fcc55c-ff7a-4df8-a36c-0e40a741d2d7 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:15.923791 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-85fcc55c-ff7a-4df8-a36c-0e40a741d2d7 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1356 microversion: 2.1 time: 0.229638 Jun 27 15:53:15.925205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 329/647] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:15 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1356 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:15.974329 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-045b6ed2-a34b-442f-8bcf-982a0ecdac28 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:15.976009 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-045b6ed2-a34b-442f-8bcf-982a0ecdac28 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:15.988789 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-045b6ed2-a34b-442f-8bcf-982a0ecdac28 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:15.990429 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-045b6ed2-a34b-442f-8bcf-982a0ecdac28 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:15.991769 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-045b6ed2-a34b-442f-8bcf-982a0ecdac28 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:15.992550 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-045b6ed2-a34b-442f-8bcf-982a0ecdac28 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:16.024804 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-045b6ed2-a34b-442f-8bcf-982a0ecdac28 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] HTTP exception thrown: Instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb could not be found. Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-045b6ed2-a34b-442f-8bcf-982a0ecdac28 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Request method failure captured: Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb HTTP/1.1 Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudE1mmjPV4F1e7Kt6odIfMxvvRt9542ZUCCkvsTh_Imzykgjec_bbDcPOQxUHGILE4kqRmk0s0dpGEl4HLn3i--mK4ymzwdVIR8G8mCEMr9z04FQKUTFwhf67Vol6UgMkP7dlfvKPEqaXFUOLxU8RweClUZvz90Rng2Ea2jSREfwnHc Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 5b5846565bf74c5cac3ff5c3168cfd48 Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-AttachVolumeTestJSON-138024671 Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:53:16.029324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:53:16.031295 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b5846565bf74c5cac3ff5c3168cfd48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b5846565bf74c5cac3ff5c3168cfd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b5846565bf74c5cac3ff5c3168cfd48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b5846565bf74c5cac3ff5c3168cfd48", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:53:16.031295 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-AttachVolumeTestJSON-138024671 Jun 27 15:53:16.031295 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 5b5846565bf74c5cac3ff5c3168cfd48 Jun 27 15:53:16.031295 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-AttachVolumeTestJSON-138024671 Jun 27 15:53:16.031295 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-AttachVolumeTestJSON-138024671-project Jun 27 15:53:16.031295 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:53:16.031295 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:53:16.031295 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: d35c652539f443d4895b5f81461833ba Jun 27 15:53:16.031295 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-AttachVolumeTestJSON-138024671-project Jun 27 15:53:16.031295 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:53:16.031295 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb could not be found. Jun 27 15:53:16.031295 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': '0a1e27a3-c6e6-42ec-9a80-fa6806324aeb'} Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb could not be found. Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:53:16.032253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:53:16.033828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:53:16.033828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:53:16.033828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:53:16.033828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:53:16.033828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:53:16.033828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:53:16.033828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:53:16.033828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb could not be found. Jun 27 15:53:16.033828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:16.033828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:53:16.033828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:16.033828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:53:16.033828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:53:16.033828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:53:16.033828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:53:16.033828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:53:16.033828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb could not be found. Jun 27 15:53:16.033828 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:16.035075 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-045b6ed2-a34b-442f-8bcf-982a0ecdac28 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Returning 404 to user: Instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:53:16.036659 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-045b6ed2-a34b-442f-8bcf-982a0ecdac28 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 404 len: 111 microversion: 2.1 time: 0.068070 Jun 27 15:53:16.037915 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 319/648] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:15 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:53:16.048272 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-711ff0df-3a7f-4231-b42d-752870c26a87 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '.version_select at 0x7fe146494dc0>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:16.075227 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-711ff0df-3a7f-4231-b42d-752870c26a87 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474949121" status: 202 len: 0 microversion: 2.1 time: 0.031995 Jun 27 15:53:16.075815 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 330/649] 10.222.0.20 () {58 vars in 1220 bytes} [Mon Jun 27 15:53:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474949121 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:53:16.944324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a09a28aa-1413-4cd5-a63b-f36489e4cb10 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:16.945017 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a09a28aa-1413-4cd5-a63b-f36489e4cb10 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:16.952099 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a09a28aa-1413-4cd5-a63b-f36489e4cb10 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:16.952550 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a09a28aa-1413-4cd5-a63b-f36489e4cb10 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:16.953335 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a09a28aa-1413-4cd5-a63b-f36489e4cb10 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:16.953802 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a09a28aa-1413-4cd5-a63b-f36489e4cb10 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:17.074598 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-8062d33a-1b23-44ca-a57d-68252eaaabe7 req-b726b9a5-3702-4e41-818a-a611dbcc77d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d5e0c6-2148-42b6-80f2-8c86f7d62e34", "name": "network-vif-plugged", "status": "completed", "tag": "f3f58277-1227-4989-91cb-3c2473267d77"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:17.110717 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-8062d33a-1b23-44ca-a57d-68252eaaabe7 req-b726b9a5-3702-4e41-818a-a611dbcc77d0 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:17.117493 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-8062d33a-1b23-44ca-a57d-68252eaaabe7 req-b726b9a5-3702-4e41-818a-a611dbcc77d0 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:17.139869 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-8062d33a-1b23-44ca-a57d-68252eaaabe7 req-b726b9a5-3702-4e41-818a-a611dbcc77d0 service nova] Creating event network-vif-plugged:f3f58277-1227-4989-91cb-3c2473267d77 for instance 04d5e0c6-2148-42b6-80f2-8c86f7d62e34 on hv-cinder-84780 Jun 27 15:53:17.153864 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a09a28aa-1413-4cd5-a63b-f36489e4cb10 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:17.156024 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-8062d33a-1b23-44ca-a57d-68252eaaabe7 req-b726b9a5-3702-4e41-818a-a611dbcc77d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089515 Jun 27 15:53:17.156638 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 331/650] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:53:17.167067 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-a09a28aa-1413-4cd5-a63b-f36489e4cb10 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1356 microversion: 2.1 time: 0.228015 Jun 27 15:53:17.168047 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 320/651] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:16 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1356 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:17.463821 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e122e03e-5581-423a-a59f-bd758866c722 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Action: 'create', calling method: .version_select at 0x7fe146479790>, body: {"keypair": {"name": "tempest-keypair-736514183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJqcnpRDdYXBJ/yfCr0vUbS5gUvOSYHcToWkaPFU0knODowJDYYlWvhN18dASmnwG0QUfFgBG9HOuAodufzaPcF3POEKO/4BvTq0nRkXEy8aitjdb1zszUPMzjXWk3bng=="}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:17.493804 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-e122e03e-5581-423a-a59f-bd758866c722 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Getting quotas for project 5b5846565bf74c5cac3ff5c3168cfd48. Resources: {'key_pairs'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:53:17.502199 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-e122e03e-5581-423a-a59f-bd758866c722 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Getting quotas for user d35c652539f443d4895b5f81461833ba and project 5b5846565bf74c5cac3ff5c3168cfd48. Resources: {'key_pairs'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:53:17.542525 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e122e03e-5581-423a-a59f-bd758866c722 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.090496 Jun 27 15:53:17.543310 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 332/652] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 27 15:53:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:53:18.194671 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-12b3d1aa-2e0d-4c32-9821-d1f807b7b92f tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:18.195068 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-12b3d1aa-2e0d-4c32-9821-d1f807b7b92f tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:18.203061 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-12b3d1aa-2e0d-4c32-9821-d1f807b7b92f tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:18.203716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-12b3d1aa-2e0d-4c32-9821-d1f807b7b92f tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:18.205531 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-12b3d1aa-2e0d-4c32-9821-d1f807b7b92f tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:18.206156 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-12b3d1aa-2e0d-4c32-9821-d1f807b7b92f tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:18.406945 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-12b3d1aa-2e0d-4c32-9821-d1f807b7b92f tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:18.429080 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-12b3d1aa-2e0d-4c32-9821-d1f807b7b92f tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1356 microversion: 2.1 time: 0.238605 Jun 27 15:53:18.430216 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 321/653] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:18 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1356 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:19.226442 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3a1830cb-07b1-49c3-a0f3-762bb47266e3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1865807735", "imageRef": "11f9be98-90d6-4c67-8d66-0b944f5a2a2b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd279a41-3cb0-4e0d-b118-71a558c9606c"}], "security_groups": [{"name": "tempest-securitygroup--531394178"}], "key_name": "tempest-keypair-736514183", "user_data": "}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:19.347459 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.network.neutron [None req-3a1830cb-07b1-49c3-a0f3-762bb47266e3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] validate_networks() for [('bd279a41-3cb0-4e0d-b118-71a558c9606c', None, None, None, None, None)] {{(pid=129473) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:53:19.454405 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-29a7afca-b918-4433-b4c8-6f67368aed25 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:19.455481 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-29a7afca-b918-4433-b4c8-6f67368aed25 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:19.463870 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-29a7afca-b918-4433-b4c8-6f67368aed25 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:19.464324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-29a7afca-b918-4433-b4c8-6f67368aed25 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:19.465129 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-29a7afca-b918-4433-b4c8-6f67368aed25 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:19.466170 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-29a7afca-b918-4433-b4c8-6f67368aed25 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:19.672142 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-29a7afca-b918-4433-b4c8-6f67368aed25 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:19.686779 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-29a7afca-b918-4433-b4c8-6f67368aed25 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1546 microversion: 2.1 time: 0.237530 Jun 27 15:53:19.688003 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 322/654] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:19 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1546 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:19.708125 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3e29d571-c194-40eb-abc5-aebf07668899 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:19.709203 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3e29d571-c194-40eb-abc5-aebf07668899 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:19.721462 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3e29d571-c194-40eb-abc5-aebf07668899 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:19.722294 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3e29d571-c194-40eb-abc5-aebf07668899 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:19.723771 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3e29d571-c194-40eb-abc5-aebf07668899 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:19.724542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3e29d571-c194-40eb-abc5-aebf07668899 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:19.989009 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-3a1830cb-07b1-49c3-a0f3-762bb47266e3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Flavor limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:53:19.989964 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-3a1830cb-07b1-49c3-a0f3-762bb47266e3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Image limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:53:19.990652 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-3a1830cb-07b1-49c3-a0f3-762bb47266e3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Flavor pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:53:19.991169 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-3a1830cb-07b1-49c3-a0f3-762bb47266e3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Image pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:53:19.991690 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-3a1830cb-07b1-49c3-a0f3-762bb47266e3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:53:19.994858 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3e29d571-c194-40eb-abc5-aebf07668899 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:20.002312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3a1830cb-07b1-49c3-a0f3-762bb47266e3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:20.003095 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3a1830cb-07b1-49c3-a0f3-762bb47266e3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:20.003947 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3a1830cb-07b1-49c3-a0f3-762bb47266e3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:20.004366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3a1830cb-07b1-49c3-a0f3-762bb47266e3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:20.009830 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3e29d571-c194-40eb-abc5-aebf07668899 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1546 microversion: 2.1 time: 0.309051 Jun 27 15:53:20.010831 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 323/655] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:19 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1546 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:20.032817 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-3a1830cb-07b1-49c3-a0f3-762bb47266e3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Getting quotas for project 5b5846565bf74c5cac3ff5c3168cfd48. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:53:20.036544 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-bc0681d3-b8a7-4e04-859b-1cdb41789b23 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:20.038441 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-3a1830cb-07b1-49c3-a0f3-762bb47266e3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Getting quotas for user d35c652539f443d4895b5f81461833ba and project 5b5846565bf74c5cac3ff5c3168cfd48. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:53:20.040568 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-bc0681d3-b8a7-4e04-859b-1cdb41789b23 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:20.041673 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-bc0681d3-b8a7-4e04-859b-1cdb41789b23 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Searching by: {'deleted': False, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94'} {{(pid=129472) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 27 15:53:20.052408 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bc0681d3-b8a7-4e04-859b-1cdb41789b23 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:20.053289 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bc0681d3-b8a7-4e04-859b-1cdb41789b23 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:20.053458 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3a1830cb-07b1-49c3-a0f3-762bb47266e3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Going to run 1 instances... {{(pid=129473) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:53:20.054992 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bc0681d3-b8a7-4e04-859b-1cdb41789b23 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:20.055856 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bc0681d3-b8a7-4e04-859b-1cdb41789b23 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:20.055976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3a1830cb-07b1-49c3-a0f3-762bb47266e3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11f9be98-90d6-4c67-8d66-0b944f5a2a2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:53:20.108079 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3a1830cb-07b1-49c3-a0f3-762bb47266e3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.891120 Jun 27 15:53:20.114165 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 333/656] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 15:53:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:53:20.124000 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ab903bfb-ac62-4666-af20-df6d339e2f7b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:20.124861 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-ab903bfb-ac62-4666-af20-df6d339e2f7b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:20.208879 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-ab903bfb-ac62-4666-af20-df6d339e2f7b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:20.219679 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.multi_cell_list [None req-bc0681d3-b8a7-4e04-859b-1cdb41789b23 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129472) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 27 15:53:20.222510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-ab903bfb-ac62-4666-af20-df6d339e2f7b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 200 len: 1237 microversion: 2.1 time: 0.106575 Jun 27 15:53:20.224163 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 334/657] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:20 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 1237 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:20.300594 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:53:20.375880 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-bc0681d3-b8a7-4e04-859b-1cdb41789b23 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.343720 Jun 27 15:53:20.376476 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 324/658] 10.222.0.20 () {58 vars in 1124 bytes} [Mon Jun 27 15:53:20 2022] GET /compute/v2.1/servers => generated 340 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:53:20.392214 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-95ead9c7-2977-4d0b-a39b-7a838621c31b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:20.393202 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-95ead9c7-2977-4d0b-a39b-7a838621c31b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:20.401489 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-95ead9c7-2977-4d0b-a39b-7a838621c31b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:20.402047 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-95ead9c7-2977-4d0b-a39b-7a838621c31b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:20.403519 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-95ead9c7-2977-4d0b-a39b-7a838621c31b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:20.404170 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-95ead9c7-2977-4d0b-a39b-7a838621c31b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:20.598092 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-95ead9c7-2977-4d0b-a39b-7a838621c31b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:20.613003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-95ead9c7-2977-4d0b-a39b-7a838621c31b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1546 microversion: 2.1 time: 0.225522 Jun 27 15:53:20.614097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 335/659] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:20 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1546 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:21.240802 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-b5e58b84-d5c9-4061-8bb3-fa360b21a76e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:21.241765 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-b5e58b84-d5c9-4061-8bb3-fa360b21a76e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:21.251740 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b5e58b84-d5c9-4061-8bb3-fa360b21a76e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:21.252240 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b5e58b84-d5c9-4061-8bb3-fa360b21a76e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:21.252985 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b5e58b84-d5c9-4061-8bb3-fa360b21a76e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:21.253426 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b5e58b84-d5c9-4061-8bb3-fa360b21a76e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:21.329045 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b5e58b84-d5c9-4061-8bb3-fa360b21a76e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:21.337545 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-b5e58b84-d5c9-4061-8bb3-fa360b21a76e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 200 len: 1289 microversion: 2.1 time: 0.100714 Jun 27 15:53:21.338210 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 325/660] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:21 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 1289 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:21.463408 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d50c7264-cb86-4cb2-b59f-858ad5bedb36 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:21.464081 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d50c7264-cb86-4cb2-b59f-858ad5bedb36 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:21.472032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d50c7264-cb86-4cb2-b59f-858ad5bedb36 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:21.472489 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d50c7264-cb86-4cb2-b59f-858ad5bedb36 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:21.473296 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d50c7264-cb86-4cb2-b59f-858ad5bedb36 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:21.473776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d50c7264-cb86-4cb2-b59f-858ad5bedb36 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:21.641629 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.objects.instance [None req-d50c7264-cb86-4cb2-b59f-858ad5bedb36 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lazy-loading 'services' on Instance uuid 936500ce-291e-420d-be24-d5a7919350f6 {{(pid=129473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:53:21.849119 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d50c7264-cb86-4cb2-b59f-858ad5bedb36 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "DELETE /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/os-volume_attachments/26b339e7-8845-452d-a332-c6aaba55a519" status: 202 len: 0 microversion: 2.1 time: 0.389220 Jun 27 15:53:21.850461 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 336/661] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 27 15:53:21 2022] DELETE /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/os-volume_attachments/26b339e7-8845-452d-a332-c6aaba55a519 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:53:21.864074 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-81c18f37-37b8-40b7-a95a-74311a956128 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:21.865391 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-81c18f37-37b8-40b7-a95a-74311a956128 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:21.875021 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81c18f37-37b8-40b7-a95a-74311a956128 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:21.875752 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81c18f37-37b8-40b7-a95a-74311a956128 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:21.876701 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81c18f37-37b8-40b7-a95a-74311a956128 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:21.877250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81c18f37-37b8-40b7-a95a-74311a956128 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:21.914159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-81c18f37-37b8-40b7-a95a-74311a956128 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056556 Jun 27 15:53:21.914970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 326/662] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 27 15:53:21 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:53:22.356579 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-fb2eb343-ae67-44e3-82b8-4dc0d16f1e7a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:22.357999 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-fb2eb343-ae67-44e3-82b8-4dc0d16f1e7a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:22.369950 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fb2eb343-ae67-44e3-82b8-4dc0d16f1e7a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:22.371032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fb2eb343-ae67-44e3-82b8-4dc0d16f1e7a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:22.373606 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fb2eb343-ae67-44e3-82b8-4dc0d16f1e7a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:22.374503 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fb2eb343-ae67-44e3-82b8-4dc0d16f1e7a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:22.392430 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-5b351fd4-a4d3-45b1-b704-37771e71c357 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cda986b2-b1cd-407a-a23a-cf82b1f10bf6"}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:22.393505 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-5b351fd4-a4d3-45b1-b704-37771e71c357 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:22.401757 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5b351fd4-a4d3-45b1-b704-37771e71c357 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:22.402535 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5b351fd4-a4d3-45b1-b704-37771e71c357 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:22.404391 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5b351fd4-a4d3-45b1-b704-37771e71c357 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:22.405162 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5b351fd4-a4d3-45b1-b704-37771e71c357 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:22.486714 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-fb2eb343-ae67-44e3-82b8-4dc0d16f1e7a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:22.501623 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-fb2eb343-ae67-44e3-82b8-4dc0d16f1e7a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 200 len: 1295 microversion: 2.1 time: 0.149528 Jun 27 15:53:22.502728 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 337/663] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:22 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 1295 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:22.896802 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-5b351fd4-a4d3-45b1-b704-37771e71c357 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "POST /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.508271 Jun 27 15:53:22.898179 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 327/664] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 27 15:53:22 2022] POST /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34/os-volume_attachments => generated 194 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:53:22.933088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4bf8ccb5-4719-4390-b0d7-7d72f9c49277 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:22.935514 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-4bf8ccb5-4719-4390-b0d7-7d72f9c49277 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:22.946091 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4bf8ccb5-4719-4390-b0d7-7d72f9c49277 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:22.947284 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4bf8ccb5-4719-4390-b0d7-7d72f9c49277 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:22.948945 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4bf8ccb5-4719-4390-b0d7-7d72f9c49277 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:22.951123 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4bf8ccb5-4719-4390-b0d7-7d72f9c49277 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:23.018075 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:53:23.031098 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4bf8ccb5-4719-4390-b0d7-7d72f9c49277 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105538 Jun 27 15:53:23.032120 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 338/665] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 27 15:53:22 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:53:23.535493 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-5057738d-61b2-42f0-beae-3eb49cfe8a03 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:23.538165 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-5057738d-61b2-42f0-beae-3eb49cfe8a03 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:23.552478 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5057738d-61b2-42f0-beae-3eb49cfe8a03 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:23.553253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5057738d-61b2-42f0-beae-3eb49cfe8a03 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:23.554698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5057738d-61b2-42f0-beae-3eb49cfe8a03 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:23.555634 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5057738d-61b2-42f0-beae-3eb49cfe8a03 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:23.777342 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-5057738d-61b2-42f0-beae-3eb49cfe8a03 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:23.802325 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-5057738d-61b2-42f0-beae-3eb49cfe8a03 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 200 len: 1362 microversion: 2.1 time: 0.276373 Jun 27 15:53:23.814854 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 328/666] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:23 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:23.940939 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-2180768e-9482-4379-9377-734ca0f27446 req-670a0dfc-8d5f-4bf9-9096-f28ce1afc26f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c290451-8495-4ac6-ba3c-28f2424d09f7", "tag": "870d2ba0-dc1e-46ce-bee6-0ce7f3252267"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:23.958314 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-2180768e-9482-4379-9377-734ca0f27446 req-670a0dfc-8d5f-4bf9-9096-f28ce1afc26f service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:23.959128 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-2180768e-9482-4379-9377-734ca0f27446 req-670a0dfc-8d5f-4bf9-9096-f28ce1afc26f service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:23.986850 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-2180768e-9482-4379-9377-734ca0f27446 req-670a0dfc-8d5f-4bf9-9096-f28ce1afc26f service nova] Creating event network-changed:870d2ba0-dc1e-46ce-bee6-0ce7f3252267 for instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 on hv-cinder-84780 Jun 27 15:53:23.995618 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-2180768e-9482-4379-9377-734ca0f27446 req-670a0dfc-8d5f-4bf9-9096-f28ce1afc26f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201952 Jun 27 15:53:23.997134 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 339/667] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:53:24.063007 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-cf1815be-6034-4ad1-b7ad-c0e534eb8d1e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:24.064607 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-cf1815be-6034-4ad1-b7ad-c0e534eb8d1e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:24.072571 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cf1815be-6034-4ad1-b7ad-c0e534eb8d1e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:24.073307 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cf1815be-6034-4ad1-b7ad-c0e534eb8d1e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:24.075460 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cf1815be-6034-4ad1-b7ad-c0e534eb8d1e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:24.075915 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cf1815be-6034-4ad1-b7ad-c0e534eb8d1e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:24.127146 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-cf1815be-6034-4ad1-b7ad-c0e534eb8d1e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086521 Jun 27 15:53:24.128099 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 329/668] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 27 15:53:24 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 15:53:24.227227 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-17bce341-296b-49d9-bcc5-3a5e22960e7b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:24.228033 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-17bce341-296b-49d9-bcc5-3a5e22960e7b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:24.236768 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-17bce341-296b-49d9-bcc5-3a5e22960e7b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:24.237524 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-17bce341-296b-49d9-bcc5-3a5e22960e7b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:24.238590 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-17bce341-296b-49d9-bcc5-3a5e22960e7b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:24.239104 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-17bce341-296b-49d9-bcc5-3a5e22960e7b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:24.277517 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-17bce341-296b-49d9-bcc5-3a5e22960e7b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Going to try to terminate instance {{(pid=129473) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:53:24.371785 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-17bce341-296b-49d9-bcc5-3a5e22960e7b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "DELETE /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 204 len: 0 microversion: 2.1 time: 0.150531 Jun 27 15:53:24.375697 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 340/669] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:53:24 2022] DELETE /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:53:24.381509 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-da298454-b16e-4428-861b-b96fc2b0a70d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:24.382270 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-da298454-b16e-4428-861b-b96fc2b0a70d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:24.391348 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-da298454-b16e-4428-861b-b96fc2b0a70d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:24.391890 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-da298454-b16e-4428-861b-b96fc2b0a70d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:24.392735 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-da298454-b16e-4428-861b-b96fc2b0a70d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:24.393241 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-da298454-b16e-4428-861b-b96fc2b0a70d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:24.579247 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-da298454-b16e-4428-861b-b96fc2b0a70d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:24.589614 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-da298454-b16e-4428-861b-b96fc2b0a70d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1688 microversion: 2.1 time: 0.212333 Jun 27 15:53:24.590248 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 330/670] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:24 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1688 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:24.822496 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e752cbbf-a9a9-451a-bf04-c644c1750ef3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:24.823354 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e752cbbf-a9a9-451a-bf04-c644c1750ef3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:24.827883 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:53:24.833359 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e752cbbf-a9a9-451a-bf04-c644c1750ef3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:24.833898 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e752cbbf-a9a9-451a-bf04-c644c1750ef3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:24.834691 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e752cbbf-a9a9-451a-bf04-c644c1750ef3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:24.835124 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e752cbbf-a9a9-451a-bf04-c644c1750ef3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:24.994127 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e752cbbf-a9a9-451a-bf04-c644c1750ef3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:25.003204 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e752cbbf-a9a9-451a-bf04-c644c1750ef3 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 200 len: 1362 microversion: 2.1 time: 0.185423 Jun 27 15:53:25.003882 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 341/671] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:24 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:25.436005 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8fca2274-0149-4196-9032-9732bbf7ae7a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:25.436498 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8fca2274-0149-4196-9032-9732bbf7ae7a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:25.444075 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8fca2274-0149-4196-9032-9732bbf7ae7a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:25.444596 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8fca2274-0149-4196-9032-9732bbf7ae7a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:25.445535 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8fca2274-0149-4196-9032-9732bbf7ae7a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:25.446001 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8fca2274-0149-4196-9032-9732bbf7ae7a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:25.479706 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-8fca2274-0149-4196-9032-9732bbf7ae7a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-volume_attachments/f8986610-f22b-4916-966b-5b86b8a8ff2f" status: 200 len: 194 microversion: 2.20 time: 0.048087 Jun 27 15:53:25.480332 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 331/672] 10.222.0.20 () {60 vars in 1453 bytes} [Mon Jun 27 15:53:25 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-volume_attachments/f8986610-f22b-4916-966b-5b86b8a8ff2f => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:53:25.549925 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c93c1764-d344-418d-aca4-fd246773d9b3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:25.550481 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c93c1764-d344-418d-aca4-fd246773d9b3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:25.557282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c93c1764-d344-418d-aca4-fd246773d9b3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:25.557833 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c93c1764-d344-418d-aca4-fd246773d9b3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:25.558823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c93c1764-d344-418d-aca4-fd246773d9b3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:25.559813 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c93c1764-d344-418d-aca4-fd246773d9b3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:25.608765 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-2012e490-1ac5-489b-b933-d0343499d273 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:25.609598 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-2012e490-1ac5-489b-b933-d0343499d273 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:25.615938 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2012e490-1ac5-489b-b933-d0343499d273 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:25.616387 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2012e490-1ac5-489b-b933-d0343499d273 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:25.617160 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2012e490-1ac5-489b-b933-d0343499d273 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:25.617593 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2012e490-1ac5-489b-b933-d0343499d273 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:25.656685 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.objects.instance [None req-c93c1764-d344-418d-aca4-fd246773d9b3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lazy-loading 'services' on Instance uuid b9cda787-8842-478e-9fae-1c95d057875f {{(pid=129473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:53:25.741897 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c93c1764-d344-418d-aca4-fd246773d9b3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-volume_attachments/f8986610-f22b-4916-966b-5b86b8a8ff2f" status: 202 len: 0 microversion: 2.20 time: 0.196487 Jun 27 15:53:25.743015 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 342/673] 10.222.0.20 () {60 vars in 1456 bytes} [Mon Jun 27 15:53:25 2022] DELETE /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-volume_attachments/f8986610-f22b-4916-966b-5b86b8a8ff2f => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:53:25.756976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-85dc4913-e1c9-4de1-9ede-06e050b4f175 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:25.758987 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-85dc4913-e1c9-4de1-9ede-06e050b4f175 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:25.770739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-85dc4913-e1c9-4de1-9ede-06e050b4f175 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:25.771549 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-85dc4913-e1c9-4de1-9ede-06e050b4f175 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:25.772955 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-85dc4913-e1c9-4de1-9ede-06e050b4f175 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:25.773767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-85dc4913-e1c9-4de1-9ede-06e050b4f175 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:25.783981 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-2012e490-1ac5-489b-b933-d0343499d273 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:25.793046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-2012e490-1ac5-489b-b933-d0343499d273 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1688 microversion: 2.1 time: 0.188210 Jun 27 15:53:25.794397 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 332/674] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:25 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:25.833811 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-85dc4913-e1c9-4de1-9ede-06e050b4f175 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084348 Jun 27 15:53:25.834888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 343/675] 10.222.0.20 () {60 vars in 1342 bytes} [Mon Jun 27 15:53:25 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:53:26.029538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-81193b6b-1812-4b99-adaf-796058b9939a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:26.030099 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-81193b6b-1812-4b99-adaf-796058b9939a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:26.036827 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81193b6b-1812-4b99-adaf-796058b9939a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:26.037288 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81193b6b-1812-4b99-adaf-796058b9939a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:26.038121 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81193b6b-1812-4b99-adaf-796058b9939a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:26.038564 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81193b6b-1812-4b99-adaf-796058b9939a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:26.193139 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-81193b6b-1812-4b99-adaf-796058b9939a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:26.207315 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-81193b6b-1812-4b99-adaf-796058b9939a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 200 len: 1362 microversion: 2.1 time: 0.181704 Jun 27 15:53:26.208366 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 333/676] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:26 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:26.817834 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-7448bdff-ea9f-4c0b-a72d-454781bb9065 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:26.819196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-7448bdff-ea9f-4c0b-a72d-454781bb9065 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:26.832223 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7448bdff-ea9f-4c0b-a72d-454781bb9065 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:26.833013 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7448bdff-ea9f-4c0b-a72d-454781bb9065 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:26.834350 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7448bdff-ea9f-4c0b-a72d-454781bb9065 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:26.835114 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7448bdff-ea9f-4c0b-a72d-454781bb9065 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:26.849084 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-24cb61eb-35df-4439-a199-a3f6f468d5ff tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:26.850475 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-24cb61eb-35df-4439-a199-a3f6f468d5ff tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:26.859100 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-24cb61eb-35df-4439-a199-a3f6f468d5ff tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:26.859561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-24cb61eb-35df-4439-a199-a3f6f468d5ff tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:26.860342 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-24cb61eb-35df-4439-a199-a3f6f468d5ff tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:26.860782 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-24cb61eb-35df-4439-a199-a3f6f468d5ff tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:26.894882 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-24cb61eb-35df-4439-a199-a3f6f468d5ff tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049878 Jun 27 15:53:26.895745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 334/677] 10.222.0.20 () {60 vars in 1342 bytes} [Mon Jun 27 15:53:26 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:53:27.020768 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-7448bdff-ea9f-4c0b-a72d-454781bb9065 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:27.029700 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-7448bdff-ea9f-4c0b-a72d-454781bb9065 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1688 microversion: 2.1 time: 0.220264 Jun 27 15:53:27.030213 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 344/678] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:26 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1688 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:27.226710 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f20e880d-4f2a-4ede-8ef7-8f313fe8ff77 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:27.227530 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f20e880d-4f2a-4ede-8ef7-8f313fe8ff77 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:27.229692 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:53:27.236922 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f20e880d-4f2a-4ede-8ef7-8f313fe8ff77 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:27.237363 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f20e880d-4f2a-4ede-8ef7-8f313fe8ff77 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:27.238536 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f20e880d-4f2a-4ede-8ef7-8f313fe8ff77 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:27.238970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f20e880d-4f2a-4ede-8ef7-8f313fe8ff77 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:27.388174 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f20e880d-4f2a-4ede-8ef7-8f313fe8ff77 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:27.396385 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f20e880d-4f2a-4ede-8ef7-8f313fe8ff77 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 200 len: 1362 microversion: 2.1 time: 0.175331 Jun 27 15:53:27.396981 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 335/679] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:27 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:27.908310 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-8b03966d-293f-432c-abd9-88e7f2f1a736 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:27.909269 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-8b03966d-293f-432c-abd9-88e7f2f1a736 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:27.916851 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8b03966d-293f-432c-abd9-88e7f2f1a736 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:27.917294 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8b03966d-293f-432c-abd9-88e7f2f1a736 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:27.918141 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8b03966d-293f-432c-abd9-88e7f2f1a736 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:27.919228 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8b03966d-293f-432c-abd9-88e7f2f1a736 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:27.953328 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-8b03966d-293f-432c-abd9-88e7f2f1a736 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049250 Jun 27 15:53:27.953949 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 345/680] 10.222.0.20 () {60 vars in 1342 bytes} [Mon Jun 27 15:53:27 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:53:28.048599 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-27f60875-b15f-4466-83cf-e75af53ba2bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:28.049269 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-27f60875-b15f-4466-83cf-e75af53ba2bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:28.056149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-27f60875-b15f-4466-83cf-e75af53ba2bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:28.056579 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-27f60875-b15f-4466-83cf-e75af53ba2bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:28.057358 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-27f60875-b15f-4466-83cf-e75af53ba2bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:28.057896 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-27f60875-b15f-4466-83cf-e75af53ba2bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:28.215954 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-27f60875-b15f-4466-83cf-e75af53ba2bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:28.230163 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-27f60875-b15f-4466-83cf-e75af53ba2bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1688 microversion: 2.1 time: 0.186123 Jun 27 15:53:28.232220 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 336/681] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:28 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:28.414570 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d75f8a52-a44d-4648-a656-b60b8d7f6464 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:28.415163 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d75f8a52-a44d-4648-a656-b60b8d7f6464 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:28.422130 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d75f8a52-a44d-4648-a656-b60b8d7f6464 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:28.422623 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d75f8a52-a44d-4648-a656-b60b8d7f6464 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:28.423545 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d75f8a52-a44d-4648-a656-b60b8d7f6464 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:28.424116 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d75f8a52-a44d-4648-a656-b60b8d7f6464 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:28.583794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d75f8a52-a44d-4648-a656-b60b8d7f6464 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:28.592580 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d75f8a52-a44d-4648-a656-b60b8d7f6464 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 200 len: 1362 microversion: 2.1 time: 0.181832 Jun 27 15:53:28.593301 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 346/682] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:28 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:28.970425 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-10f63d7f-667f-4be4-8b15-1f0648616200 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:28.971605 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-10f63d7f-667f-4be4-8b15-1f0648616200 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:28.978756 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-10f63d7f-667f-4be4-8b15-1f0648616200 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:28.979385 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-10f63d7f-667f-4be4-8b15-1f0648616200 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:28.980320 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-10f63d7f-667f-4be4-8b15-1f0648616200 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:28.980947 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-10f63d7f-667f-4be4-8b15-1f0648616200 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:29.020969 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-10f63d7f-667f-4be4-8b15-1f0648616200 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056557 Jun 27 15:53:29.022193 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 337/683] 10.222.0.20 () {60 vars in 1342 bytes} [Mon Jun 27 15:53:28 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:53:29.249909 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e1db2547-dee9-44fd-b49e-8dc3dd391baf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:29.250840 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e1db2547-dee9-44fd-b49e-8dc3dd391baf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:29.258735 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e1db2547-dee9-44fd-b49e-8dc3dd391baf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:29.259353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e1db2547-dee9-44fd-b49e-8dc3dd391baf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:29.260372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e1db2547-dee9-44fd-b49e-8dc3dd391baf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:29.260911 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e1db2547-dee9-44fd-b49e-8dc3dd391baf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:29.612615 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a9877ad8-e76b-4edb-bf60-e6734fc7a04e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:29.613658 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a9877ad8-e76b-4edb-bf60-e6734fc7a04e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:29.624425 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a9877ad8-e76b-4edb-bf60-e6734fc7a04e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:29.625132 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a9877ad8-e76b-4edb-bf60-e6734fc7a04e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:29.626609 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a9877ad8-e76b-4edb-bf60-e6734fc7a04e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:29.627143 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a9877ad8-e76b-4edb-bf60-e6734fc7a04e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:29.635264 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e1db2547-dee9-44fd-b49e-8dc3dd391baf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:29.651089 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e1db2547-dee9-44fd-b49e-8dc3dd391baf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1688 microversion: 2.1 time: 0.405273 Jun 27 15:53:29.652253 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 347/684] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:29 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1688 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:29.860788 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a9877ad8-e76b-4edb-bf60-e6734fc7a04e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:29.886884 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-a9877ad8-e76b-4edb-bf60-e6734fc7a04e tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 200 len: 1362 microversion: 2.1 time: 0.279277 Jun 27 15:53:29.901745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 338/685] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:29 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:30.039580 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-5c423516-7d22-493e-abeb-b6ed3f056afb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:30.041774 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-5c423516-7d22-493e-abeb-b6ed3f056afb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:30.053825 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=2 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:53:30.054135 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-e8a20c1a-8ed2-4ce1-96e6-4b666941a92e req-de98a7f9-ec40-4603-a0bc-a550cb0f2dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936500ce-291e-420d-be24-d5a7919350f6", "name": "network-vif-deleted", "tag": "df282c39-1e8b-43bd-9dde-0ce20496061e"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:30.070790 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-e8a20c1a-8ed2-4ce1-96e6-4b666941a92e req-de98a7f9-ec40-4603-a0bc-a550cb0f2dc2 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:30.071568 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-e8a20c1a-8ed2-4ce1-96e6-4b666941a92e req-de98a7f9-ec40-4603-a0bc-a550cb0f2dc2 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:30.072789 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5c423516-7d22-493e-abeb-b6ed3f056afb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:30.074092 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5c423516-7d22-493e-abeb-b6ed3f056afb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:30.076010 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5c423516-7d22-493e-abeb-b6ed3f056afb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:30.077290 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5c423516-7d22-493e-abeb-b6ed3f056afb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:30.094665 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-e8a20c1a-8ed2-4ce1-96e6-4b666941a92e req-de98a7f9-ec40-4603-a0bc-a550cb0f2dc2 service nova] Creating event network-vif-deleted:df282c39-1e8b-43bd-9dde-0ce20496061e for instance 936500ce-291e-420d-be24-d5a7919350f6 on hv-cinder-84780 Jun 27 15:53:30.104201 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-e8a20c1a-8ed2-4ce1-96e6-4b666941a92e req-de98a7f9-ec40-4603-a0bc-a550cb0f2dc2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057521 Jun 27 15:53:30.110640 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 339/686] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:53:30.143741 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-5c423516-7d22-493e-abeb-b6ed3f056afb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.111008 Jun 27 15:53:30.149905 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 348/687] 10.222.0.20 () {60 vars in 1342 bytes} [Mon Jun 27 15:53:30 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:53:30.677825 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=2 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:53:30.685998 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-e662ee7d-be4f-43d7-86f9-557d5a92289b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:30.687122 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-e662ee7d-be4f-43d7-86f9-557d5a92289b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:30.700538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e662ee7d-be4f-43d7-86f9-557d5a92289b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:30.701701 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e662ee7d-be4f-43d7-86f9-557d5a92289b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:30.703477 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e662ee7d-be4f-43d7-86f9-557d5a92289b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:30.705545 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e662ee7d-be4f-43d7-86f9-557d5a92289b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:30.767225 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0549b6df-94e6-42a8-82b0-1ae6296dac1a tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:30.770590 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-0549b6df-94e6-42a8-82b0-1ae6296dac1a tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:30.781580 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=12 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:53:30.802039 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0549b6df-94e6-42a8-82b0-1ae6296dac1a tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:30.804899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0549b6df-94e6-42a8-82b0-1ae6296dac1a tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:30.806658 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0549b6df-94e6-42a8-82b0-1ae6296dac1a tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:30.808448 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0549b6df-94e6-42a8-82b0-1ae6296dac1a tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:30.880741 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:53:30.928781 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e662ee7d-be4f-43d7-86f9-557d5a92289b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:30.929580 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e662ee7d-be4f-43d7-86f9-557d5a92289b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:30.930400 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-e662ee7d-be4f-43d7-86f9-557d5a92289b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lazy-loading 'fault' on Instance uuid 936500ce-291e-420d-be24-d5a7919350f6 {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:53:31.455404 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-e662ee7d-be4f-43d7-86f9-557d5a92289b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:31.470414 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-e662ee7d-be4f-43d7-86f9-557d5a92289b tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 200 len: 1334 microversion: 2.1 time: 0.794142 Jun 27 15:53:31.480176 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 340/688] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:30 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 1334 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:31.486478 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-0214c6d7-dbe7-4fe2-aa8b-733551c77d95 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:31.487389 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-0214c6d7-dbe7-4fe2-aa8b-733551c77d95 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:31.494887 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0214c6d7-dbe7-4fe2-aa8b-733551c77d95 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:31.495555 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0214c6d7-dbe7-4fe2-aa8b-733551c77d95 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:31.497100 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0214c6d7-dbe7-4fe2-aa8b-733551c77d95 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:31.497784 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0214c6d7-dbe7-4fe2-aa8b-733551c77d95 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:31.573938 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-0549b6df-94e6-42a8-82b0-1ae6296dac1a tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:31.584953 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-0549b6df-94e6-42a8-82b0-1ae6296dac1a tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1592 microversion: 2.1 time: 0.824855 Jun 27 15:53:31.585822 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 349/689] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:30 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1592 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:31.604683 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d8cec309-9380-46b5-9924-e9269544c4dd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:31.606144 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d8cec309-9380-46b5-9924-e9269544c4dd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:31.621926 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d8cec309-9380-46b5-9924-e9269544c4dd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:31.624184 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d8cec309-9380-46b5-9924-e9269544c4dd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:31.639860 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d8cec309-9380-46b5-9924-e9269544c4dd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:31.640652 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d8cec309-9380-46b5-9924-e9269544c4dd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:31.693295 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d8cec309-9380-46b5-9924-e9269544c4dd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.092722 Jun 27 15:53:31.694296 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 350/690] 10.222.0.20 () {60 vars in 1342 bytes} [Mon Jun 27 15:53:31 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:31.738224 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0214c6d7-dbe7-4fe2-aa8b-733551c77d95 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:31.758613 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-0214c6d7-dbe7-4fe2-aa8b-733551c77d95 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 200 len: 1362 microversion: 2.1 time: 0.275568 Jun 27 15:53:31.760550 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 341/691] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:31 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:31.810171 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-61f78333-0b0b-44ed-882c-89527b58d5a6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:31.811374 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-61f78333-0b0b-44ed-882c-89527b58d5a6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:31.818653 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-61f78333-0b0b-44ed-882c-89527b58d5a6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:31.819165 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-61f78333-0b0b-44ed-882c-89527b58d5a6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:31.820178 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-61f78333-0b0b-44ed-882c-89527b58d5a6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:31.826441 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-61f78333-0b0b-44ed-882c-89527b58d5a6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:31.884116 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-61f78333-0b0b-44ed-882c-89527b58d5a6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Going to try to terminate instance {{(pid=129473) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:53:32.035974 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-61f78333-0b0b-44ed-882c-89527b58d5a6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 204 len: 0 microversion: 2.20 time: 0.229254 Jun 27 15:53:32.038442 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 351/692] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Jun 27 15:53:31 2022] DELETE /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 15:53:32.050882 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-5d00e140-1bd2-483c-b188-3a7a6a06d52a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:32.054117 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-5d00e140-1bd2-483c-b188-3a7a6a06d52a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:32.069183 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5d00e140-1bd2-483c-b188-3a7a6a06d52a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:32.069997 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5d00e140-1bd2-483c-b188-3a7a6a06d52a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:32.071827 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5d00e140-1bd2-483c-b188-3a7a6a06d52a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:32.072838 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5d00e140-1bd2-483c-b188-3a7a6a06d52a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:32.265471 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-5d00e140-1bd2-483c-b188-3a7a6a06d52a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:32.274677 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-5d00e140-1bd2-483c-b188-3a7a6a06d52a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:32.276193 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-5d00e140-1bd2-483c-b188-3a7a6a06d52a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:32.277402 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-5d00e140-1bd2-483c-b188-3a7a6a06d52a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1724 microversion: 2.20 time: 0.233079 Jun 27 15:53:32.279161 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 342/693] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:53:32 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:53:32.493186 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-440e16a3-cb38-4fbc-9d64-28ed808d7f4f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:32.494896 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-440e16a3-cb38-4fbc-9d64-28ed808d7f4f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 936500ce-291e-420d-be24-d5a7919350f6] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:32.506719 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-440e16a3-cb38-4fbc-9d64-28ed808d7f4f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:32.507495 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-440e16a3-cb38-4fbc-9d64-28ed808d7f4f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:32.508875 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-440e16a3-cb38-4fbc-9d64-28ed808d7f4f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:32.509605 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-440e16a3-cb38-4fbc-9d64-28ed808d7f4f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:32.519446 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:53:32.538292 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-440e16a3-cb38-4fbc-9d64-28ed808d7f4f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] HTTP exception thrown: Instance 936500ce-291e-420d-be24-d5a7919350f6 could not be found. Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-440e16a3-cb38-4fbc-9d64-28ed808d7f4f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Request method failure captured: Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 HTTP/1.1 Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudE47SqYCXFSdwZD2N57kXyxbMrtAm6wX1EHtWWUQlN--Jwn5T-qbUh8GEOB_fIgz7HnxVWw5uliaKnGFA9JAZI-vk9FE28h8V1LQOmG3Cr5YsOFNKtSr0bpkyXAEDcif6-AZEMpUP4PExRgpVR393bo3hncJYpBO41EPMQZDXHDQyI Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: f5e448e724fa479ea693168592686391 Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-852477413 Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:53:32.541426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:53:32.544561 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5e448e724fa479ea693168592686391"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5e448e724fa479ea693168592686391"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5e448e724fa479ea693168592686391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5e448e724fa479ea693168592686391", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:53:32.544561 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-ServerRescueNegativeTestJSON-852477413 Jun 27 15:53:32.544561 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: f5e448e724fa479ea693168592686391 Jun 27 15:53:32.544561 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-852477413 Jun 27 15:53:32.544561 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-ServerRescueNegativeTestJSON-852477413-project Jun 27 15:53:32.544561 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:53:32.544561 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:53:32.544561 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 1a7a81da8acf40849a9ea86e2542ae6a Jun 27 15:53:32.544561 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-ServerRescueNegativeTestJSON-852477413-project Jun 27 15:53:32.544561 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:53:32.544561 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance 936500ce-291e-420d-be24-d5a7919350f6 could not be found. Jun 27 15:53:32.544561 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': '936500ce-291e-420d-be24-d5a7919350f6'} Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 936500ce-291e-420d-be24-d5a7919350f6 could not be found. Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:53:32.547739 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:53:32.551282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:53:32.551282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:53:32.551282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:53:32.551282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:53:32.551282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:53:32.551282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:53:32.551282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:53:32.551282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 936500ce-291e-420d-be24-d5a7919350f6 could not be found. Jun 27 15:53:32.551282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:53:32.551282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:53:32.551282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:53:32.551282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:53:32.551282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:53:32.551282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:53:32.551282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:53:32.551282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:53:32.551282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 936500ce-291e-420d-be24-d5a7919350f6 could not be found. Jun 27 15:53:32.551282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:53:32.554785 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-440e16a3-cb38-4fbc-9d64-28ed808d7f4f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Returning 404 to user: Instance 936500ce-291e-420d-be24-d5a7919350f6 could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:53:32.554785 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-440e16a3-cb38-4fbc-9d64-28ed808d7f4f tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6" status: 404 len: 111 microversion: 2.1 time: 0.058925 Jun 27 15:53:32.554785 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 352/694] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:32 2022] GET /compute/v2.1/servers/936500ce-291e-420d-be24-d5a7919350f6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:53:32.561198 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-25ed5b4c-0c3e-416c-8583-d39275547277 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '.version_select at 0x7fe145ba19d0>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:32.591952 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-25ed5b4c-0c3e-416c-8583-d39275547277 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-167403970" status: 202 len: 0 microversion: 2.1 time: 0.039032 Jun 27 15:53:32.597314 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 343/695] 10.222.0.20 () {58 vars in 1217 bytes} [Mon Jun 27 15:53:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-167403970 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:53:32.784806 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-acc434ee-9596-4ce7-9bd8-02d6b4ed50ad tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:32.786628 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-acc434ee-9596-4ce7-9bd8-02d6b4ed50ad tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:32.799958 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-acc434ee-9596-4ce7-9bd8-02d6b4ed50ad tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:32.800764 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-acc434ee-9596-4ce7-9bd8-02d6b4ed50ad tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:32.802215 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-acc434ee-9596-4ce7-9bd8-02d6b4ed50ad tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:32.803264 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-acc434ee-9596-4ce7-9bd8-02d6b4ed50ad tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:33.176613 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-acc434ee-9596-4ce7-9bd8-02d6b4ed50ad tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:33.202110 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-acc434ee-9596-4ce7-9bd8-02d6b4ed50ad tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 200 len: 1362 microversion: 2.1 time: 0.427411 Jun 27 15:53:33.212153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 353/696] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:32 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 1362 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:33.224892 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-4ab832fd-2aa9-4e1b-9547-cb1634d9d29c req-c60c04b7-c074-4336-9178-fc6bc8ecbe9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c290451-8495-4ac6-ba3c-28f2424d09f7", "name": "network-vif-plugged", "status": "completed", "tag": "870d2ba0-dc1e-46ce-bee6-0ce7f3252267"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:33.245612 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-4ab832fd-2aa9-4e1b-9547-cb1634d9d29c req-c60c04b7-c074-4336-9178-fc6bc8ecbe9b service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:33.247867 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-4ab832fd-2aa9-4e1b-9547-cb1634d9d29c req-c60c04b7-c074-4336-9178-fc6bc8ecbe9b service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:33.273673 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-4ab832fd-2aa9-4e1b-9547-cb1634d9d29c req-c60c04b7-c074-4336-9178-fc6bc8ecbe9b service nova] Creating event network-vif-plugged:870d2ba0-dc1e-46ce-bee6-0ce7f3252267 for instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 on hv-cinder-84780 Jun 27 15:53:33.284698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-4ab832fd-2aa9-4e1b-9547-cb1634d9d29c req-c60c04b7-c074-4336-9178-fc6bc8ecbe9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065984 Jun 27 15:53:33.287069 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 344/697] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:53:33.303281 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-08d72d14-1750-47e6-b613-aa575a20b47a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:33.305244 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-08d72d14-1750-47e6-b613-aa575a20b47a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:33.322294 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-08d72d14-1750-47e6-b613-aa575a20b47a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:33.323617 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-08d72d14-1750-47e6-b613-aa575a20b47a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:33.328448 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-08d72d14-1750-47e6-b613-aa575a20b47a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:33.329385 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-08d72d14-1750-47e6-b613-aa575a20b47a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:33.681771 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-08d72d14-1750-47e6-b613-aa575a20b47a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:33.700977 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-08d72d14-1750-47e6-b613-aa575a20b47a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:33.704377 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-08d72d14-1750-47e6-b613-aa575a20b47a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:33.706509 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-08d72d14-1750-47e6-b613-aa575a20b47a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1724 microversion: 2.20 time: 0.409488 Jun 27 15:53:33.722203 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 354/698] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:53:33 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1724 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:53:34.237622 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a47dd0fa-48d9-4577-8297-408e53e39d8a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:34.238914 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a47dd0fa-48d9-4577-8297-408e53e39d8a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:34.256275 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a47dd0fa-48d9-4577-8297-408e53e39d8a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:34.257279 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a47dd0fa-48d9-4577-8297-408e53e39d8a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:34.258588 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a47dd0fa-48d9-4577-8297-408e53e39d8a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:34.259225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a47dd0fa-48d9-4577-8297-408e53e39d8a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:34.516391 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-1e758282-6c44-4b55-b5a6-02e3c984b2f0 req-38a1ca38-ffb2-4d2f-afc2-2a4803b4d4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d5e0c6-2148-42b6-80f2-8c86f7d62e34", "tag": "f3f58277-1227-4989-91cb-3c2473267d77"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:34.542436 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-1e758282-6c44-4b55-b5a6-02e3c984b2f0 req-38a1ca38-ffb2-4d2f-afc2-2a4803b4d4a0 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:34.544366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-1e758282-6c44-4b55-b5a6-02e3c984b2f0 req-38a1ca38-ffb2-4d2f-afc2-2a4803b4d4a0 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:34.564185 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-1e758282-6c44-4b55-b5a6-02e3c984b2f0 req-38a1ca38-ffb2-4d2f-afc2-2a4803b4d4a0 service nova] Creating event network-changed:f3f58277-1227-4989-91cb-3c2473267d77 for instance 04d5e0c6-2148-42b6-80f2-8c86f7d62e34 on hv-cinder-84780 Jun 27 15:53:34.571090 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-1e758282-6c44-4b55-b5a6-02e3c984b2f0 req-38a1ca38-ffb2-4d2f-afc2-2a4803b4d4a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059236 Jun 27 15:53:34.571971 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 355/699] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:53:34.738334 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-eff13526-bdc9-4c0e-924a-778eac9c1529 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:34.739565 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-eff13526-bdc9-4c0e-924a-778eac9c1529 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:34.752176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eff13526-bdc9-4c0e-924a-778eac9c1529 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:34.752873 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eff13526-bdc9-4c0e-924a-778eac9c1529 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:34.754121 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eff13526-bdc9-4c0e-924a-778eac9c1529 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:34.754707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eff13526-bdc9-4c0e-924a-778eac9c1529 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:34.868288 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a47dd0fa-48d9-4577-8297-408e53e39d8a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:34.896008 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-a47dd0fa-48d9-4577-8297-408e53e39d8a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 200 len: 1362 microversion: 2.1 time: 0.674647 Jun 27 15:53:34.897610 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 345/700] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:34 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 1362 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:35.404158 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-eff13526-bdc9-4c0e-924a-778eac9c1529 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:35.416547 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-eff13526-bdc9-4c0e-924a-778eac9c1529 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:35.423666 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-eff13526-bdc9-4c0e-924a-778eac9c1529 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:35.424916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-eff13526-bdc9-4c0e-924a-778eac9c1529 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1724 microversion: 2.20 time: 0.693161 Jun 27 15:53:35.437889 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 356/701] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:53:34 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1724 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:53:35.926924 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-665ae089-a66a-4f7c-b24a-ff7988e0c07b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:35.927982 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-665ae089-a66a-4f7c-b24a-ff7988e0c07b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:35.946225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-665ae089-a66a-4f7c-b24a-ff7988e0c07b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:35.946888 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-665ae089-a66a-4f7c-b24a-ff7988e0c07b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:35.948029 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-665ae089-a66a-4f7c-b24a-ff7988e0c07b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:35.948610 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-665ae089-a66a-4f7c-b24a-ff7988e0c07b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:36.033383 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-d42ca6ba-2133-45f4-860c-591e4be6df7c req-fc9b2b5e-667a-4fbd-a833-0399d774001e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9cda787-8842-478e-9fae-1c95d057875f", "name": "network-vif-deleted", "tag": "cc266a26-7ff1-44ed-a332-b97209b03a63"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:36.088966 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-d42ca6ba-2133-45f4-860c-591e4be6df7c req-fc9b2b5e-667a-4fbd-a833-0399d774001e service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:36.089587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-d42ca6ba-2133-45f4-860c-591e4be6df7c req-fc9b2b5e-667a-4fbd-a833-0399d774001e service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:36.131590 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-d42ca6ba-2133-45f4-860c-591e4be6df7c req-fc9b2b5e-667a-4fbd-a833-0399d774001e service nova] Creating event network-vif-deleted:cc266a26-7ff1-44ed-a332-b97209b03a63 for instance b9cda787-8842-478e-9fae-1c95d057875f on hv-cinder-84780 Jun 27 15:53:36.156923 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-d42ca6ba-2133-45f4-860c-591e4be6df7c req-fc9b2b5e-667a-4fbd-a833-0399d774001e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129797 Jun 27 15:53:36.160861 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 357/702] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:53:36.314125 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-72be93b0-9d5f-41ef-90fa-4bbdfbd6fb64 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:36.314917 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-72be93b0-9d5f-41ef-90fa-4bbdfbd6fb64 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:36.334177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-72be93b0-9d5f-41ef-90fa-4bbdfbd6fb64 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:36.337971 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-72be93b0-9d5f-41ef-90fa-4bbdfbd6fb64 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:36.339073 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-72be93b0-9d5f-41ef-90fa-4bbdfbd6fb64 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:36.339577 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-72be93b0-9d5f-41ef-90fa-4bbdfbd6fb64 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:36.353115 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-665ae089-a66a-4f7c-b24a-ff7988e0c07b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:36.371344 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-665ae089-a66a-4f7c-b24a-ff7988e0c07b tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 200 len: 1549 microversion: 2.1 time: 0.451861 Jun 27 15:53:36.373234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 346/703] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:35 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 1549 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:36.394622 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f2c141f6-81e7-4e3d-9a39-d7cd38897602 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:36.397940 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f2c141f6-81e7-4e3d-9a39-d7cd38897602 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:36.413472 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f2c141f6-81e7-4e3d-9a39-d7cd38897602 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:36.418575 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f2c141f6-81e7-4e3d-9a39-d7cd38897602 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:36.419823 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f2c141f6-81e7-4e3d-9a39-d7cd38897602 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:36.421701 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f2c141f6-81e7-4e3d-9a39-d7cd38897602 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:36.426907 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-72be93b0-9d5f-41ef-90fa-4bbdfbd6fb64 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Going to try to terminate instance {{(pid=129473) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:53:36.648233 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-72be93b0-9d5f-41ef-90fa-4bbdfbd6fb64 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "DELETE /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 204 len: 0 microversion: 2.1 time: 0.338088 Jun 27 15:53:36.652527 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 358/704] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:53:36 2022] DELETE /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:53:36.671344 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f2c141f6-81e7-4e3d-9a39-d7cd38897602 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.282765 Jun 27 15:53:36.672462 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 347/705] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jun 27 15:53:36 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-interface => generated 285 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:53:36.678758 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e2d364f0-c757-4411-a346-aafb8a44e71a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:36.682613 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3732c742-0e35-4a3f-b3a5-5fce710960c1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:36.685531 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e2d364f0-c757-4411-a346-aafb8a44e71a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:36.688960 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3732c742-0e35-4a3f-b3a5-5fce710960c1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:36.728800 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3732c742-0e35-4a3f-b3a5-5fce710960c1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:36.730247 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e2d364f0-c757-4411-a346-aafb8a44e71a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:36.731224 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e2d364f0-c757-4411-a346-aafb8a44e71a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:36.732260 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3732c742-0e35-4a3f-b3a5-5fce710960c1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:36.733935 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e2d364f0-c757-4411-a346-aafb8a44e71a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:36.735719 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3732c742-0e35-4a3f-b3a5-5fce710960c1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:36.737526 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3732c742-0e35-4a3f-b3a5-5fce710960c1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:36.737848 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e2d364f0-c757-4411-a346-aafb8a44e71a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:36.866846 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e2d364f0-c757-4411-a346-aafb8a44e71a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:36.867948 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e2d364f0-c757-4411-a346-aafb8a44e71a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:36.869194 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.objects.instance [None req-e2d364f0-c757-4411-a346-aafb8a44e71a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lazy-loading 'fault' on Instance uuid b9cda787-8842-478e-9fae-1c95d057875f {{(pid=129473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:53:37.057543 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e2d364f0-c757-4411-a346-aafb8a44e71a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:37.089395 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e2d364f0-c757-4411-a346-aafb8a44e71a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:37.094721 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e2d364f0-c757-4411-a346-aafb8a44e71a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:37.097599 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e2d364f0-c757-4411-a346-aafb8a44e71a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1372 microversion: 2.20 time: 0.442828 Jun 27 15:53:37.101511 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 359/706] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:53:36 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1372 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:53:37.256712 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3732c742-0e35-4a3f-b3a5-5fce710960c1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:37.269338 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3732c742-0e35-4a3f-b3a5-5fce710960c1 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1508 microversion: 2.1 time: 0.594970 Jun 27 15:53:37.271557 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 348/707] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:36 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1508 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:37.469981 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e0d2d419-4c7d-4094-9fd4-b16dfe7df5b9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1882686125"}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:37.470784 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e0d2d419-4c7d-4094-9fd4-b16dfe7df5b9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:37.480425 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e0d2d419-4c7d-4094-9fd4-b16dfe7df5b9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:37.481348 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e0d2d419-4c7d-4094-9fd4-b16dfe7df5b9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:37.482943 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e0d2d419-4c7d-4094-9fd4-b16dfe7df5b9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:37.483477 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e0d2d419-4c7d-4094-9fd4-b16dfe7df5b9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:37.777883 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.network.security_group_api [None req-e0d2d419-4c7d-4094-9fd4-b16dfe7df5b9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Adding security group c0758086-aa6a-415a-ba3e-2cfab41a8498 to port f3f58277-1227-4989-91cb-3c2473267d77 Jun 27 15:53:38.128104 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3a79ab63-57c0-4174-9baa-1b79a00e8b43 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:38.129044 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3a79ab63-57c0-4174-9baa-1b79a00e8b43 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:38.136052 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3a79ab63-57c0-4174-9baa-1b79a00e8b43 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:38.136594 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3a79ab63-57c0-4174-9baa-1b79a00e8b43 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:38.138064 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3a79ab63-57c0-4174-9baa-1b79a00e8b43 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:38.138648 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3a79ab63-57c0-4174-9baa-1b79a00e8b43 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:38.175839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3a79ab63-57c0-4174-9baa-1b79a00e8b43 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:38.176299 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3a79ab63-57c0-4174-9baa-1b79a00e8b43 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:38.176744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-3a79ab63-57c0-4174-9baa-1b79a00e8b43 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lazy-loading 'fault' on Instance uuid b9cda787-8842-478e-9fae-1c95d057875f {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:53:38.292765 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3a79ab63-57c0-4174-9baa-1b79a00e8b43 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:38.311484 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3a79ab63-57c0-4174-9baa-1b79a00e8b43 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:38.314833 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3a79ab63-57c0-4174-9baa-1b79a00e8b43 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:38.316979 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3a79ab63-57c0-4174-9baa-1b79a00e8b43 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 200 len: 1372 microversion: 2.20 time: 0.192708 Jun 27 15:53:38.326409 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 349/708] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:53:38 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 1372 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:53:38.332595 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-21a08610-6148-44fa-b48c-8b6bb960c428 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:38.333470 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-21a08610-6148-44fa-b48c-8b6bb960c428 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:38.341136 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-21a08610-6148-44fa-b48c-8b6bb960c428 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:38.341565 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-21a08610-6148-44fa-b48c-8b6bb960c428 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:38.342408 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-21a08610-6148-44fa-b48c-8b6bb960c428 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:38.342851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-21a08610-6148-44fa-b48c-8b6bb960c428 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:38.989753 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-21a08610-6148-44fa-b48c-8b6bb960c428 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:39.007803 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-21a08610-6148-44fa-b48c-8b6bb960c428 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1508 microversion: 2.1 time: 0.679510 Jun 27 15:53:39.009841 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 350/709] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:38 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1508 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:39.102367 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e0d2d419-4c7d-4094-9fd4-b16dfe7df5b9 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "POST /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34/action" status: 202 len: 0 microversion: 2.1 time: 1.637045 Jun 27 15:53:39.110269 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 360/710] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 27 15:53:37 2022] POST /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34/action => generated 0 bytes in 1648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:53:39.136498 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c55727b0-0d63-4d92-beba-eb409c227ba2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:39.138821 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c55727b0-0d63-4d92-beba-eb409c227ba2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:39.154131 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c55727b0-0d63-4d92-beba-eb409c227ba2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:39.155849 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c55727b0-0d63-4d92-beba-eb409c227ba2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:39.158089 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c55727b0-0d63-4d92-beba-eb409c227ba2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:39.161024 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c55727b0-0d63-4d92-beba-eb409c227ba2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:39.371369 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-5ecb4d77-7b6d-4fb0-bf9f-ceb3c6183dda req-79a9629c-7640-4228-9f90-0935c62580aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d5e0c6-2148-42b6-80f2-8c86f7d62e34", "tag": "f3f58277-1227-4989-91cb-3c2473267d77"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:39.395317 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-5ecb4d77-7b6d-4fb0-bf9f-ceb3c6183dda req-79a9629c-7640-4228-9f90-0935c62580aa service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:39.395949 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-5ecb4d77-7b6d-4fb0-bf9f-ceb3c6183dda req-79a9629c-7640-4228-9f90-0935c62580aa service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:39.413680 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-5ecb4d77-7b6d-4fb0-bf9f-ceb3c6183dda req-79a9629c-7640-4228-9f90-0935c62580aa service nova] Creating event network-changed:f3f58277-1227-4989-91cb-3c2473267d77 for instance 04d5e0c6-2148-42b6-80f2-8c86f7d62e34 on hv-cinder-84780 Jun 27 15:53:39.432863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-5ecb4d77-7b6d-4fb0-bf9f-ceb3c6183dda req-79a9629c-7640-4228-9f90-0935c62580aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.325011 Jun 27 15:53:39.435646 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 351/711] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:53:39.451820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3941ca74-b8a4-485b-b0b2-81883dd2982e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:39.453066 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3941ca74-b8a4-485b-b0b2-81883dd2982e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:39.461932 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3941ca74-b8a4-485b-b0b2-81883dd2982e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:39.462779 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3941ca74-b8a4-485b-b0b2-81883dd2982e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:39.464178 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3941ca74-b8a4-485b-b0b2-81883dd2982e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:39.464952 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3941ca74-b8a4-485b-b0b2-81883dd2982e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:39.493147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-3941ca74-b8a4-485b-b0b2-81883dd2982e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] HTTP exception thrown: Instance b9cda787-8842-478e-9fae-1c95d057875f could not be found. Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3941ca74-b8a4-485b-b0b2-81883dd2982e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Request method failure captured: Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f HTTP/1.1 Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudGT-29gJSaPG9yRbV3WCZW3eyz3_EztkPHwj0NbSTDMnF3G40kk8EaUr0pRdqYXBttyn45sIxL7Ex__hCs-mfI1OPIB7VGEnk3L-o3lbUuJSbudzww_VDODiLxWXJ_o-hW1Yfl1t0k-uPvmiKu11boP05BbWdlDOLlHyqn4vFO831U Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 5d416620e9f942ab9f76e6b117cd8b61 Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-614482775 Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:53:39.495337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:53:39.496952 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d416620e9f942ab9f76e6b117cd8b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d416620e9f942ab9f76e6b117cd8b61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d416620e9f942ab9f76e6b117cd8b61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d416620e9f942ab9f76e6b117cd8b61", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:53:39.496952 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-AttachVolumeShelveTestJSON-614482775 Jun 27 15:53:39.496952 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 5d416620e9f942ab9f76e6b117cd8b61 Jun 27 15:53:39.496952 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-614482775 Jun 27 15:53:39.496952 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-AttachVolumeShelveTestJSON-614482775-project Jun 27 15:53:39.496952 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:53:39.496952 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:53:39.496952 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: 6890639a0a2e4ca9b103919fdbbffc5b Jun 27 15:53:39.496952 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-AttachVolumeShelveTestJSON-614482775-project Jun 27 15:53:39.496952 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:53:39.496952 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance b9cda787-8842-478e-9fae-1c95d057875f could not be found. Jun 27 15:53:39.496952 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': 'b9cda787-8842-478e-9fae-1c95d057875f'} Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9cda787-8842-478e-9fae-1c95d057875f could not be found. Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:53:39.497845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:53:39.499151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:53:39.499151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:53:39.499151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:53:39.499151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:53:39.499151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:53:39.499151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:53:39.499151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:53:39.499151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9cda787-8842-478e-9fae-1c95d057875f could not be found. Jun 27 15:53:39.499151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:39.499151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:53:39.499151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:39.499151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:53:39.499151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:53:39.499151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:53:39.499151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:53:39.499151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:53:39.499151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9cda787-8842-478e-9fae-1c95d057875f could not be found. Jun 27 15:53:39.499151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:39.503088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3941ca74-b8a4-485b-b0b2-81883dd2982e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Returning 404 to user: Instance b9cda787-8842-478e-9fae-1c95d057875f could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:53:39.504338 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3941ca74-b8a4-485b-b0b2-81883dd2982e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 404 len: 111 microversion: 2.20 time: 0.067321 Jun 27 15:53:39.505159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 352/712] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:53:39 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:53:39.526982 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c19b9099-f919-4687-bd9a-bc4a3591a097 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '.version_select at 0x7fe14ac629d0>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:39.573830 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c19b9099-f919-4687-bd9a-bc4a3591a097 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963151989" status: 204 len: 0 microversion: 2.20 time: 0.059191 Jun 27 15:53:39.575604 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 353/713] 10.222.0.20 () {60 vars in 1261 bytes} [Mon Jun 27 15:53:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963151989 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 15:53:39.849998 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-c55727b0-0d63-4d92-beba-eb409c227ba2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:39.878124 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c55727b0-0d63-4d92-beba-eb409c227ba2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1758 microversion: 2.1 time: 0.758351 Jun 27 15:53:39.879216 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 361/714] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:39 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1758 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:40.038817 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d076022d-d9a7-416f-b12b-dbbb1cd0cead tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:40.039571 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d076022d-d9a7-416f-b12b-dbbb1cd0cead tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:40.079245 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d076022d-d9a7-416f-b12b-dbbb1cd0cead tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:40.084939 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d076022d-d9a7-416f-b12b-dbbb1cd0cead tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:40.084939 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d076022d-d9a7-416f-b12b-dbbb1cd0cead tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:40.087643 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d076022d-d9a7-416f-b12b-dbbb1cd0cead tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:40.505600 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d076022d-d9a7-416f-b12b-dbbb1cd0cead tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:40.519444 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d076022d-d9a7-416f-b12b-dbbb1cd0cead tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1508 microversion: 2.1 time: 0.488744 Jun 27 15:53:40.521490 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 354/715] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:40 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1508 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:40.607016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-c3a94866-4319-4761-af31-4dfff16bf8c0 req-1eb1a098-8f35-4493-bf42-98da70eda07d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "470a42f9-27c4-4ae0-958d-f3de3d434563", "name": "network-vif-deleted", "tag": "917720a6-7efc-4170-b135-c693c95e0ee7"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:40.623383 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-c3a94866-4319-4761-af31-4dfff16bf8c0 req-1eb1a098-8f35-4493-bf42-98da70eda07d service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:40.624357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-c3a94866-4319-4761-af31-4dfff16bf8c0 req-1eb1a098-8f35-4493-bf42-98da70eda07d service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:40.640425 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-c3a94866-4319-4761-af31-4dfff16bf8c0 req-1eb1a098-8f35-4493-bf42-98da70eda07d service nova] Creating event network-vif-deleted:917720a6-7efc-4170-b135-c693c95e0ee7 for instance 470a42f9-27c4-4ae0-958d-f3de3d434563 on hv-cinder-84780 Jun 27 15:53:40.647268 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-c3a94866-4319-4761-af31-4dfff16bf8c0 req-1eb1a098-8f35-4493-bf42-98da70eda07d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046334 Jun 27 15:53:40.653526 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 362/716] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:53:40.762313 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-e9799183-4f02-47a5-9d33-d1c155ca28d8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:40.763534 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-e9799183-4f02-47a5-9d33-d1c155ca28d8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:40.788391 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e9799183-4f02-47a5-9d33-d1c155ca28d8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:40.789205 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e9799183-4f02-47a5-9d33-d1c155ca28d8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:40.790343 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e9799183-4f02-47a5-9d33-d1c155ca28d8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:40.792196 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e9799183-4f02-47a5-9d33-d1c155ca28d8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:40.879973 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-e9799183-4f02-47a5-9d33-d1c155ca28d8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Going to try to terminate instance {{(pid=129472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:53:41.031532 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-e9799183-4f02-47a5-9d33-d1c155ca28d8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 204 len: 0 microversion: 2.1 time: 0.276603 Jun 27 15:53:41.032496 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 355/717] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:53:40 2022] DELETE /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:53:41.041873 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-5868033a-5618-44be-bc71-56c9875dad96 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:41.042592 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-5868033a-5618-44be-bc71-56c9875dad96 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:41.055667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5868033a-5618-44be-bc71-56c9875dad96 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:41.056146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5868033a-5618-44be-bc71-56c9875dad96 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:41.056944 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5868033a-5618-44be-bc71-56c9875dad96 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:41.057389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5868033a-5618-44be-bc71-56c9875dad96 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:41.382992 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-5868033a-5618-44be-bc71-56c9875dad96 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:41.397859 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-5868033a-5618-44be-bc71-56c9875dad96 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1575 microversion: 2.1 time: 0.360050 Jun 27 15:53:41.398941 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 363/718] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:41 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1575 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:41.539533 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-0437e983-3f6e-4ba1-97cb-e7b05f65d009 req-0592ce49-33b7-40f7-8f36-f2d1d2ef8d56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c290451-8495-4ac6-ba3c-28f2424d09f7", "tag": "870d2ba0-dc1e-46ce-bee6-0ce7f3252267"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:41.554507 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a1ba5be1-5f69-4bd2-9c0c-99eb0fd232a2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:41.556169 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-0437e983-3f6e-4ba1-97cb-e7b05f65d009 req-0592ce49-33b7-40f7-8f36-f2d1d2ef8d56 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:41.556378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a1ba5be1-5f69-4bd2-9c0c-99eb0fd232a2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:41.556623 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-0437e983-3f6e-4ba1-97cb-e7b05f65d009 req-0592ce49-33b7-40f7-8f36-f2d1d2ef8d56 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:41.568031 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a1ba5be1-5f69-4bd2-9c0c-99eb0fd232a2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:41.568488 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a1ba5be1-5f69-4bd2-9c0c-99eb0fd232a2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:41.569297 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a1ba5be1-5f69-4bd2-9c0c-99eb0fd232a2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:41.571107 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-0437e983-3f6e-4ba1-97cb-e7b05f65d009 req-0592ce49-33b7-40f7-8f36-f2d1d2ef8d56 service nova] Creating event network-changed:870d2ba0-dc1e-46ce-bee6-0ce7f3252267 for instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 on hv-cinder-84780 Jun 27 15:53:41.576219 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a1ba5be1-5f69-4bd2-9c0c-99eb0fd232a2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:41.579580 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-0437e983-3f6e-4ba1-97cb-e7b05f65d009 req-0592ce49-33b7-40f7-8f36-f2d1d2ef8d56 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044275 Jun 27 15:53:41.581489 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 356/719] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:53:41.631733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a1ba5be1-5f69-4bd2-9c0c-99eb0fd232a2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:41.632267 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a1ba5be1-5f69-4bd2-9c0c-99eb0fd232a2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:41.632832 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.objects.instance [None req-a1ba5be1-5f69-4bd2-9c0c-99eb0fd232a2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lazy-loading 'fault' on Instance uuid 470a42f9-27c4-4ae0-958d-f3de3d434563 {{(pid=129473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:53:41.671342 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-cef1bca8-3c37-4e9e-b008-84add5083093 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Action: 'create', calling method: .version_select at 0x7fe145bb5ee0>, body: {"keypair": {"name": "tempest-keypair-1218625900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0poNyFLlLwy1UEmbbLcsZe2/543IVnfcj5yepgSMLOYrSZzinY10XXteEKGlEecyGybuhA/VyvLP60n3dokj6ASTXiEctS8anyy3/MLzRPoPn9XS1SsJbuHS3X8LmKVw=="}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:41.687911 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-cef1bca8-3c37-4e9e-b008-84add5083093 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Getting quotas for project 5d416620e9f942ab9f76e6b117cd8b61. Resources: {'key_pairs'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:53:41.693085 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-cef1bca8-3c37-4e9e-b008-84add5083093 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Getting quotas for user 6890639a0a2e4ca9b103919fdbbffc5b and project 5d416620e9f942ab9f76e6b117cd8b61. Resources: {'key_pairs'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:53:41.693358 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a1ba5be1-5f69-4bd2-9c0c-99eb0fd232a2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:41.705223 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a1ba5be1-5f69-4bd2-9c0c-99eb0fd232a2 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 200 len: 1312 microversion: 2.1 time: 0.161417 Jun 27 15:53:41.706233 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 364/720] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:41 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:41.732768 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-cef1bca8-3c37-4e9e-b008-84add5083093 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.066834 Jun 27 15:53:41.733568 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 357/721] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Jun 27 15:53:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 27 15:53:42.482710 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3aea9fa2-e5c2-4389-a4b8-30f716c5f903 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:42.483970 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3aea9fa2-e5c2-4389-a4b8-30f716c5f903 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:42.497658 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3aea9fa2-e5c2-4389-a4b8-30f716c5f903 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:42.499111 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3aea9fa2-e5c2-4389-a4b8-30f716c5f903 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:42.501198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3aea9fa2-e5c2-4389-a4b8-30f716c5f903 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:42.502071 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3aea9fa2-e5c2-4389-a4b8-30f716c5f903 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:42.728108 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-31d09568-5870-4bf4-9fe3-54a7c727a011 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:42.728905 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-31d09568-5870-4bf4-9fe3-54a7c727a011 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 470a42f9-27c4-4ae0-958d-f3de3d434563] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:42.736337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-31d09568-5870-4bf4-9fe3-54a7c727a011 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:42.736689 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-31d09568-5870-4bf4-9fe3-54a7c727a011 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:42.737441 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-31d09568-5870-4bf4-9fe3-54a7c727a011 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:42.738127 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-31d09568-5870-4bf4-9fe3-54a7c727a011 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:42.756804 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-31d09568-5870-4bf4-9fe3-54a7c727a011 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] HTTP exception thrown: Instance 470a42f9-27c4-4ae0-958d-f3de3d434563 could not be found. Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-31d09568-5870-4bf4-9fe3-54a7c727a011 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Request method failure captured: Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 HTTP/1.1 Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudE47SqYCXFSdwZD2N57kXyxbMrtAm6wX1EHtWWUQlN--Jwn5T-qbUh8GEOB_fIgz7HnxVWw5uliaKnGFA9JAZI-vk9FE28h8V1LQOmG3Cr5YsOFNKtSr0bpkyXAEDcif6-AZEMpUP4PExRgpVR393bo3hncJYpBO41EPMQZDXHDQyI Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: f5e448e724fa479ea693168592686391 Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-852477413 Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:53:42.758995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:53:42.760405 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5e448e724fa479ea693168592686391"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5e448e724fa479ea693168592686391"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5e448e724fa479ea693168592686391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5e448e724fa479ea693168592686391", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:53:42.760405 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-ServerRescueNegativeTestJSON-852477413 Jun 27 15:53:42.760405 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: f5e448e724fa479ea693168592686391 Jun 27 15:53:42.760405 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-852477413 Jun 27 15:53:42.760405 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-ServerRescueNegativeTestJSON-852477413-project Jun 27 15:53:42.760405 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:53:42.760405 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:53:42.760405 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: 1a7a81da8acf40849a9ea86e2542ae6a Jun 27 15:53:42.760405 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-ServerRescueNegativeTestJSON-852477413-project Jun 27 15:53:42.760405 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:53:42.760405 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance 470a42f9-27c4-4ae0-958d-f3de3d434563 could not be found. Jun 27 15:53:42.760405 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': '470a42f9-27c4-4ae0-958d-f3de3d434563'} Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 470a42f9-27c4-4ae0-958d-f3de3d434563 could not be found. Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:53:42.761350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:53:42.763327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:53:42.763327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:53:42.763327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:53:42.763327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:53:42.763327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:53:42.763327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:53:42.763327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:53:42.763327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 470a42f9-27c4-4ae0-958d-f3de3d434563 could not be found. Jun 27 15:53:42.763327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:42.763327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:53:42.763327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:42.763327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:53:42.763327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:53:42.763327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:53:42.763327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:53:42.763327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:53:42.763327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 470a42f9-27c4-4ae0-958d-f3de3d434563 could not be found. Jun 27 15:53:42.763327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:42.766648 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-31d09568-5870-4bf4-9fe3-54a7c727a011 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Returning 404 to user: Instance 470a42f9-27c4-4ae0-958d-f3de3d434563 could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:53:42.767798 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-31d09568-5870-4bf4-9fe3-54a7c727a011 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563" status: 404 len: 111 microversion: 2.1 time: 0.044359 Jun 27 15:53:42.768545 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 358/722] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:42 2022] GET /compute/v2.1/servers/470a42f9-27c4-4ae0-958d-f3de3d434563 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:53:42.779390 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-60072697-86e7-4b38-b521-c208ee98509e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:42.780697 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-60072697-86e7-4b38-b521-c208ee98509e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:42.790575 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-60072697-86e7-4b38-b521-c208ee98509e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:42.791666 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-60072697-86e7-4b38-b521-c208ee98509e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:42.792815 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-60072697-86e7-4b38-b521-c208ee98509e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:42.793531 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-60072697-86e7-4b38-b521-c208ee98509e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:42.837800 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3aea9fa2-e5c2-4389-a4b8-30f716c5f903 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:42.850240 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-60072697-86e7-4b38-b521-c208ee98509e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Going to try to terminate instance {{(pid=129472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:53:42.853808 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3aea9fa2-e5c2-4389-a4b8-30f716c5f903 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1575 microversion: 2.1 time: 0.378762 Jun 27 15:53:42.854849 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 365/723] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:42 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1575 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:42.931934 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:53:42.979579 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-60072697-86e7-4b38-b521-c208ee98509e tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "DELETE /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 204 len: 0 microversion: 2.1 time: 0.204884 Jun 27 15:53:42.985985 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 359/724] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:53:42 2022] DELETE /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:53:42.995486 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e8d61169-d54c-49f1-bb06-8a302643ab10 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:42.998315 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e8d61169-d54c-49f1-bb06-8a302643ab10 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:43.010825 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e8d61169-d54c-49f1-bb06-8a302643ab10 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:43.012734 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e8d61169-d54c-49f1-bb06-8a302643ab10 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:43.016070 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e8d61169-d54c-49f1-bb06-8a302643ab10 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:43.017311 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e8d61169-d54c-49f1-bb06-8a302643ab10 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:43.239980 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e8d61169-d54c-49f1-bb06-8a302643ab10 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:43.254642 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e8d61169-d54c-49f1-bb06-8a302643ab10 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.266243 Jun 27 15:53:43.255581 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 366/725] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:42 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:43.554133 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-b19ac6a4-9f76-4588-886b-ed384d5ba4d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1135292820", "imageRef": "11f9be98-90d6-4c67-8d66-0b944f5a2a2b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e01f7daa-9879-48a7-a8dc-d6cb6ac6f291"}], "security_groups": [{"name": "tempest-securitygroup--203332601"}], "key_name": "tempest-keypair-1218625900", "user_data": "}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:43.678274 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.network.neutron [None req-b19ac6a4-9f76-4588-886b-ed384d5ba4d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] validate_networks() for [('e01f7daa-9879-48a7-a8dc-d6cb6ac6f291', None, None, None, None, None)] {{(pid=129472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:53:43.880828 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-04d5607d-8320-4e08-8d34-d9ada60b6396 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:43.881466 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-04d5607d-8320-4e08-8d34-d9ada60b6396 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:43.889197 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-04d5607d-8320-4e08-8d34-d9ada60b6396 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:43.889667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-04d5607d-8320-4e08-8d34-d9ada60b6396 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:43.890477 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-04d5607d-8320-4e08-8d34-d9ada60b6396 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:43.890921 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-04d5607d-8320-4e08-8d34-d9ada60b6396 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:44.115651 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-04d5607d-8320-4e08-8d34-d9ada60b6396 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:44.125499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-04d5607d-8320-4e08-8d34-d9ada60b6396 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1575 microversion: 2.1 time: 0.248628 Jun 27 15:53:44.126415 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 367/726] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:43 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1575 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:44.243487 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-b19ac6a4-9f76-4588-886b-ed384d5ba4d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Flavor limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:53:44.244188 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-b19ac6a4-9f76-4588-886b-ed384d5ba4d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Image limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:53:44.244376 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-b19ac6a4-9f76-4588-886b-ed384d5ba4d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Flavor pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:53:44.244790 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-b19ac6a4-9f76-4588-886b-ed384d5ba4d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Image pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:53:44.245205 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-b19ac6a4-9f76-4588-886b-ed384d5ba4d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:53:44.256481 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b19ac6a4-9f76-4588-886b-ed384d5ba4d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:44.257091 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b19ac6a4-9f76-4588-886b-ed384d5ba4d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:44.257971 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b19ac6a4-9f76-4588-886b-ed384d5ba4d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:44.258407 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b19ac6a4-9f76-4588-886b-ed384d5ba4d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:44.276223 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3646fda8-2c58-45ef-950f-465cfa0fc160 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:44.277596 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3646fda8-2c58-45ef-950f-465cfa0fc160 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:44.278683 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-b19ac6a4-9f76-4588-886b-ed384d5ba4d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Getting quotas for project 5d416620e9f942ab9f76e6b117cd8b61. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:53:44.283885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-b19ac6a4-9f76-4588-886b-ed384d5ba4d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Getting quotas for user 6890639a0a2e4ca9b103919fdbbffc5b and project 5d416620e9f942ab9f76e6b117cd8b61. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:53:44.285157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3646fda8-2c58-45ef-950f-465cfa0fc160 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:44.285765 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3646fda8-2c58-45ef-950f-465cfa0fc160 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:44.286697 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3646fda8-2c58-45ef-950f-465cfa0fc160 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:44.287244 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3646fda8-2c58-45ef-950f-465cfa0fc160 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:44.297391 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-b19ac6a4-9f76-4588-886b-ed384d5ba4d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Going to run 1 instances... {{(pid=129472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:53:44.299837 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-b19ac6a4-9f76-4588-886b-ed384d5ba4d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11f9be98-90d6-4c67-8d66-0b944f5a2a2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:53:44.375726 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-b19ac6a4-9f76-4588-886b-ed384d5ba4d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.825850 Jun 27 15:53:44.376698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 360/727] 10.222.0.20 () {62 vars in 1187 bytes} [Mon Jun 27 15:53:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 27 15:53:44.395184 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8e4b0b8b-eccc-4da6-944b-572159ee7d72 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:44.396472 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8e4b0b8b-eccc-4da6-944b-572159ee7d72 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:44.414244 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:53:44.476182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3646fda8-2c58-45ef-950f-465cfa0fc160 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:44.488179 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3646fda8-2c58-45ef-950f-465cfa0fc160 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.215986 Jun 27 15:53:44.489521 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 368/728] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:44 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:44.497139 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8e4b0b8b-eccc-4da6-944b-572159ee7d72 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:44.506027 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8e4b0b8b-eccc-4da6-944b-572159ee7d72 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:44.507884 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8e4b0b8b-eccc-4da6-944b-572159ee7d72 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:44.509195 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-8e4b0b8b-eccc-4da6-944b-572159ee7d72 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1282 microversion: 2.20 time: 0.122274 Jun 27 15:53:44.509793 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 361/729] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:53:44 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1282 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:53:45.150233 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3c347da7-420a-4d1a-891b-76d045ccf76e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:45.150854 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3c347da7-420a-4d1a-891b-76d045ccf76e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:45.159014 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3c347da7-420a-4d1a-891b-76d045ccf76e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:45.159533 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3c347da7-420a-4d1a-891b-76d045ccf76e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:45.160565 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3c347da7-420a-4d1a-891b-76d045ccf76e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:45.161063 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3c347da7-420a-4d1a-891b-76d045ccf76e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:45.183019 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:53:45.353109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3c347da7-420a-4d1a-891b-76d045ccf76e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:45.365241 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3c347da7-420a-4d1a-891b-76d045ccf76e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1575 microversion: 2.1 time: 0.219043 Jun 27 15:53:45.365937 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 369/730] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:45 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1575 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:45.516889 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3110b079-43cb-4563-ac6b-7872be27827d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:45.517458 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3110b079-43cb-4563-ac6b-7872be27827d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:45.525067 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3110b079-43cb-4563-ac6b-7872be27827d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:45.525525 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3110b079-43cb-4563-ac6b-7872be27827d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:45.526360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3110b079-43cb-4563-ac6b-7872be27827d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:45.526841 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3110b079-43cb-4563-ac6b-7872be27827d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:45.545087 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d4e302cb-c202-433c-8100-2f4ddbbc5453 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:45.546562 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d4e302cb-c202-433c-8100-2f4ddbbc5453 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:45.557833 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d4e302cb-c202-433c-8100-2f4ddbbc5453 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:45.560265 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d4e302cb-c202-433c-8100-2f4ddbbc5453 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:45.561806 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d4e302cb-c202-433c-8100-2f4ddbbc5453 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:45.562610 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d4e302cb-c202-433c-8100-2f4ddbbc5453 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:45.656230 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d4e302cb-c202-433c-8100-2f4ddbbc5453 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:45.674227 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d4e302cb-c202-433c-8100-2f4ddbbc5453 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:45.677695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d4e302cb-c202-433c-8100-2f4ddbbc5453 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:45.680447 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d4e302cb-c202-433c-8100-2f4ddbbc5453 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1286 microversion: 2.20 time: 0.143962 Jun 27 15:53:45.681560 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 370/731] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:53:45 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1286 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:53:45.731628 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3110b079-43cb-4563-ac6b-7872be27827d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:45.739646 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3110b079-43cb-4563-ac6b-7872be27827d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.226725 Jun 27 15:53:45.740243 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 362/732] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:45 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:46.383208 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a4b05daf-2774-4365-8aaa-b3a608a50eb3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:46.383984 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a4b05daf-2774-4365-8aaa-b3a608a50eb3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:46.398095 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a4b05daf-2774-4365-8aaa-b3a608a50eb3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:46.399303 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a4b05daf-2774-4365-8aaa-b3a608a50eb3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:46.400779 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a4b05daf-2774-4365-8aaa-b3a608a50eb3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:46.401874 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a4b05daf-2774-4365-8aaa-b3a608a50eb3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:46.635973 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a4b05daf-2774-4365-8aaa-b3a608a50eb3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:46.646769 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a4b05daf-2774-4365-8aaa-b3a608a50eb3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1575 microversion: 2.1 time: 0.267313 Jun 27 15:53:46.647687 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 371/733] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:46 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1575 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:46.703787 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-dab9d6af-83b4-4690-a8e2-5b7a2e81234b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:46.705080 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-dab9d6af-83b4-4690-a8e2-5b7a2e81234b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:46.717341 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dab9d6af-83b4-4690-a8e2-5b7a2e81234b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:46.718115 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dab9d6af-83b4-4690-a8e2-5b7a2e81234b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:46.719656 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dab9d6af-83b4-4690-a8e2-5b7a2e81234b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:46.720482 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dab9d6af-83b4-4690-a8e2-5b7a2e81234b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:46.764622 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-27d5608b-fa3f-4a14-984b-eddc19bd29bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:46.766316 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-27d5608b-fa3f-4a14-984b-eddc19bd29bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:46.786977 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-27d5608b-fa3f-4a14-984b-eddc19bd29bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:46.788741 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-27d5608b-fa3f-4a14-984b-eddc19bd29bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:46.806636 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-27d5608b-fa3f-4a14-984b-eddc19bd29bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:46.806636 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-27d5608b-fa3f-4a14-984b-eddc19bd29bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:46.893893 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-dab9d6af-83b4-4690-a8e2-5b7a2e81234b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:46.924750 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-dab9d6af-83b4-4690-a8e2-5b7a2e81234b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:46.928297 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-dab9d6af-83b4-4690-a8e2-5b7a2e81234b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:46.930708 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-dab9d6af-83b4-4690-a8e2-5b7a2e81234b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1334 microversion: 2.20 time: 0.234245 Jun 27 15:53:46.934907 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 363/734] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:53:46 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1334 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:53:47.077809 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-27d5608b-fa3f-4a14-984b-eddc19bd29bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:47.087496 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-27d5608b-fa3f-4a14-984b-eddc19bd29bf tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1522 microversion: 2.1 time: 0.331754 Jun 27 15:53:47.088815 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 372/735] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:46 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:47.287453 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-eac4b53b-66d1-41d0-8172-fd3ef2ea7513 req-937bfe58-2680-4e28-b7af-b91434a50e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a90fed-157b-47f0-bd62-401e29342025", "name": "network-vif-unplugged", "status": "completed", "tag": "7f8f5cac-5782-481c-b444-127b88873db3"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:47.312413 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-eac4b53b-66d1-41d0-8172-fd3ef2ea7513 req-937bfe58-2680-4e28-b7af-b91434a50e53 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:47.313385 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-eac4b53b-66d1-41d0-8172-fd3ef2ea7513 req-937bfe58-2680-4e28-b7af-b91434a50e53 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:47.341887 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-eac4b53b-66d1-41d0-8172-fd3ef2ea7513 req-937bfe58-2680-4e28-b7af-b91434a50e53 service nova] Creating event network-vif-unplugged:7f8f5cac-5782-481c-b444-127b88873db3 for instance b6a90fed-157b-47f0-bd62-401e29342025 on hv-cinder-84780 Jun 27 15:53:47.350796 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-eac4b53b-66d1-41d0-8172-fd3ef2ea7513 req-937bfe58-2680-4e28-b7af-b91434a50e53 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070374 Jun 27 15:53:47.352164 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 364/736] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:53:47.673342 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-dd546833-1b56-4d00-946b-c212c38e0ee4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:47.674044 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-dd546833-1b56-4d00-946b-c212c38e0ee4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:47.680991 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dd546833-1b56-4d00-946b-c212c38e0ee4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:47.681453 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dd546833-1b56-4d00-946b-c212c38e0ee4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:47.682278 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dd546833-1b56-4d00-946b-c212c38e0ee4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:47.682720 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dd546833-1b56-4d00-946b-c212c38e0ee4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:47.845313 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-dd546833-1b56-4d00-946b-c212c38e0ee4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:47.853669 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-dd546833-1b56-4d00-946b-c212c38e0ee4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1575 microversion: 2.1 time: 0.184629 Jun 27 15:53:47.854269 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 373/737] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:47 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:47.963556 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9403834a-cca8-4efc-b9a1-dc46c5d255b9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:47.965741 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9403834a-cca8-4efc-b9a1-dc46c5d255b9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:47.976625 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9403834a-cca8-4efc-b9a1-dc46c5d255b9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:47.977807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9403834a-cca8-4efc-b9a1-dc46c5d255b9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:47.979103 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9403834a-cca8-4efc-b9a1-dc46c5d255b9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:47.979835 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9403834a-cca8-4efc-b9a1-dc46c5d255b9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:48.057402 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9403834a-cca8-4efc-b9a1-dc46c5d255b9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:48.067459 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9403834a-cca8-4efc-b9a1-dc46c5d255b9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:48.069081 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9403834a-cca8-4efc-b9a1-dc46c5d255b9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:48.070310 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9403834a-cca8-4efc-b9a1-dc46c5d255b9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1340 microversion: 2.20 time: 0.112358 Jun 27 15:53:48.070899 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 365/738] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:53:47 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1340 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:53:48.106864 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-427bba17-1126-44f7-a2ff-14ebc4a92b4d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:48.107503 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-427bba17-1126-44f7-a2ff-14ebc4a92b4d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:48.114695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-427bba17-1126-44f7-a2ff-14ebc4a92b4d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:48.115153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-427bba17-1126-44f7-a2ff-14ebc4a92b4d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:48.115967 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-427bba17-1126-44f7-a2ff-14ebc4a92b4d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:48.116408 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-427bba17-1126-44f7-a2ff-14ebc4a92b4d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:48.186891 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-427bba17-1126-44f7-a2ff-14ebc4a92b4d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:48.195082 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-427bba17-1126-44f7-a2ff-14ebc4a92b4d tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1480 microversion: 2.1 time: 0.093535 Jun 27 15:53:48.195686 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 374/739] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:48 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1480 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:48.602377 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-7b41132b-9718-4738-bb53-b6d96f91f4f3 req-32f3e295-ba60-485a-9f34-20e3aed7e289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5", "name": "network-vif-deleted", "tag": "db62c7bb-5168-441d-a55f-cb931ba441a4"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:48.616309 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-7b41132b-9718-4738-bb53-b6d96f91f4f3 req-32f3e295-ba60-485a-9f34-20e3aed7e289 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:48.616951 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-7b41132b-9718-4738-bb53-b6d96f91f4f3 req-32f3e295-ba60-485a-9f34-20e3aed7e289 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:48.635928 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-7b41132b-9718-4738-bb53-b6d96f91f4f3 req-32f3e295-ba60-485a-9f34-20e3aed7e289 service nova] Creating event network-vif-deleted:db62c7bb-5168-441d-a55f-cb931ba441a4 for instance 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 on hv-cinder-84780 Jun 27 15:53:48.643788 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-7b41132b-9718-4738-bb53-b6d96f91f4f3 req-32f3e295-ba60-485a-9f34-20e3aed7e289 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045111 Jun 27 15:53:48.645457 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 366/740] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:53:48.876016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f38de301-698a-436b-9255-e63ccf5c563c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:48.877021 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f38de301-698a-436b-9255-e63ccf5c563c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:48.889445 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f38de301-698a-436b-9255-e63ccf5c563c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:48.890302 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f38de301-698a-436b-9255-e63ccf5c563c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:48.892098 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f38de301-698a-436b-9255-e63ccf5c563c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:48.892685 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f38de301-698a-436b-9255-e63ccf5c563c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:49.028688 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f38de301-698a-436b-9255-e63ccf5c563c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:49.040901 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f38de301-698a-436b-9255-e63ccf5c563c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1508 microversion: 2.1 time: 0.171428 Jun 27 15:53:49.041890 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 375/741] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:48 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:49.099669 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a4eadf82-66c0-4e9e-ab18-3e089721f69a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:49.101228 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a4eadf82-66c0-4e9e-ab18-3e089721f69a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:49.112813 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a4eadf82-66c0-4e9e-ab18-3e089721f69a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:49.113422 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a4eadf82-66c0-4e9e-ab18-3e089721f69a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:49.114605 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a4eadf82-66c0-4e9e-ab18-3e089721f69a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:49.115183 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a4eadf82-66c0-4e9e-ab18-3e089721f69a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:49.197805 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a4eadf82-66c0-4e9e-ab18-3e089721f69a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:49.213183 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-26249604-41cf-4549-9f0d-851514fb56cc tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:49.214106 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-26249604-41cf-4549-9f0d-851514fb56cc tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:49.224716 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-26249604-41cf-4549-9f0d-851514fb56cc tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:49.226077 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a4eadf82-66c0-4e9e-ab18-3e089721f69a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:49.228086 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a4eadf82-66c0-4e9e-ab18-3e089721f69a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:49.228946 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-26249604-41cf-4549-9f0d-851514fb56cc tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:49.230807 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-26249604-41cf-4549-9f0d-851514fb56cc tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:49.232389 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-a4eadf82-66c0-4e9e-ab18-3e089721f69a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1340 microversion: 2.20 time: 0.144346 Jun 27 15:53:49.233181 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-26249604-41cf-4549-9f0d-851514fb56cc tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:49.239157 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 367/742] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:53:49 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1340 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:53:49.275235 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-26249604-41cf-4549-9f0d-851514fb56cc tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:49.275863 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-26249604-41cf-4549-9f0d-851514fb56cc tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:49.276766 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.objects.instance [None req-26249604-41cf-4549-9f0d-851514fb56cc tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lazy-loading 'fault' on Instance uuid 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 {{(pid=129473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:53:49.365990 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-26249604-41cf-4549-9f0d-851514fb56cc tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7a81da8acf40849a9ea86e2542ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e448e724fa479ea693168592686391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:49.375824 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-26249604-41cf-4549-9f0d-851514fb56cc tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 200 len: 1312 microversion: 2.1 time: 0.166764 Jun 27 15:53:49.377038 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 376/743] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:49 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:50.067116 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-782e532f-cdb2-4dbd-868b-f1892bf1b36a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:50.068288 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-782e532f-cdb2-4dbd-868b-f1892bf1b36a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:50.082705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-782e532f-cdb2-4dbd-868b-f1892bf1b36a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:50.083535 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-782e532f-cdb2-4dbd-868b-f1892bf1b36a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:50.084877 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-782e532f-cdb2-4dbd-868b-f1892bf1b36a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:50.085675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-782e532f-cdb2-4dbd-868b-f1892bf1b36a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:50.127854 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-782e532f-cdb2-4dbd-868b-f1892bf1b36a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:50.128889 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-782e532f-cdb2-4dbd-868b-f1892bf1b36a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:50.128889 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-782e532f-cdb2-4dbd-868b-f1892bf1b36a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lazy-loading 'fault' on Instance uuid b6a90fed-157b-47f0-bd62-401e29342025 {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:53:50.207060 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-782e532f-cdb2-4dbd-868b-f1892bf1b36a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:50.216689 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-782e532f-cdb2-4dbd-868b-f1892bf1b36a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 200 len: 1230 microversion: 2.1 time: 0.157240 Jun 27 15:53:50.217283 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 368/744] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:50 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 1230 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:50.257854 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b3b1e2f2-bd9d-4fe9-9458-f1fbef11b566 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:50.260130 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b3b1e2f2-bd9d-4fe9-9458-f1fbef11b566 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:50.273875 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b3b1e2f2-bd9d-4fe9-9458-f1fbef11b566 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:50.275170 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b3b1e2f2-bd9d-4fe9-9458-f1fbef11b566 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:50.277500 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b3b1e2f2-bd9d-4fe9-9458-f1fbef11b566 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:50.278744 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b3b1e2f2-bd9d-4fe9-9458-f1fbef11b566 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:50.426097 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-95a26477-8d93-45ae-bede-0c8c4a5b0ff8 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:50.426916 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-95a26477-8d93-45ae-bede-0c8c4a5b0ff8 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] [instance: 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:50.467320 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-95a26477-8d93-45ae-bede-0c8c4a5b0ff8 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:50.468688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-95a26477-8d93-45ae-bede-0c8c4a5b0ff8 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:50.470537 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-95a26477-8d93-45ae-bede-0c8c4a5b0ff8 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:50.472780 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-95a26477-8d93-45ae-bede-0c8c4a5b0ff8 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:50.527141 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-95a26477-8d93-45ae-bede-0c8c4a5b0ff8 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] HTTP exception thrown: Instance 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 could not be found. Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-95a26477-8d93-45ae-bede-0c8c4a5b0ff8 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Request method failure captured: Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 HTTP/1.1 Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudE47SqYCXFSdwZD2N57kXyxbMrtAm6wX1EHtWWUQlN--Jwn5T-qbUh8GEOB_fIgz7HnxVWw5uliaKnGFA9JAZI-vk9FE28h8V1LQOmG3Cr5YsOFNKtSr0bpkyXAEDcif6-AZEMpUP4PExRgpVR393bo3hncJYpBO41EPMQZDXHDQyI Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: f5e448e724fa479ea693168592686391 Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-852477413 Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:53:50.538312 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:53:50.541253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5e448e724fa479ea693168592686391"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5e448e724fa479ea693168592686391"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5e448e724fa479ea693168592686391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5e448e724fa479ea693168592686391", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:53:50.541253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-ServerRescueNegativeTestJSON-852477413 Jun 27 15:53:50.541253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: f5e448e724fa479ea693168592686391 Jun 27 15:53:50.541253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-852477413 Jun 27 15:53:50.541253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-ServerRescueNegativeTestJSON-852477413-project Jun 27 15:53:50.541253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:53:50.541253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:53:50.541253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: 1a7a81da8acf40849a9ea86e2542ae6a Jun 27 15:53:50.541253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-ServerRescueNegativeTestJSON-852477413-project Jun 27 15:53:50.541253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:53:50.541253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 could not be found. Jun 27 15:53:50.541253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': '985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5'} Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 could not be found. Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:53:50.543200 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:53:50.546745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:53:50.546745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:53:50.546745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:53:50.546745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:53:50.546745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:53:50.546745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:53:50.546745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:53:50.546745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 could not be found. Jun 27 15:53:50.546745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:50.546745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:53:50.546745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:50.546745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:53:50.546745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:53:50.546745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:53:50.546745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:53:50.546745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:53:50.546745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 could not be found. Jun 27 15:53:50.546745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:53:50.553846 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-95a26477-8d93-45ae-bede-0c8c4a5b0ff8 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] Returning 404 to user: Instance 985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:53:50.556631 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-95a26477-8d93-45ae-bede-0c8c4a5b0ff8 tempest-ServerRescueNegativeTestJSON-852477413 tempest-ServerRescueNegativeTestJSON-852477413-project] 10.222.0.20 "GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5" status: 404 len: 111 microversion: 2.1 time: 0.155497 Jun 27 15:53:50.560854 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 369/745] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:50 2022] GET /compute/v2.1/servers/985e339a-eb9c-4ad9-8adc-7fcd2f2a2ba5 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:53:50.670333 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b3b1e2f2-bd9d-4fe9-9458-f1fbef11b566 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:50.682389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b3b1e2f2-bd9d-4fe9-9458-f1fbef11b566 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:50.684962 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b3b1e2f2-bd9d-4fe9-9458-f1fbef11b566 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:50.686645 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b3b1e2f2-bd9d-4fe9-9458-f1fbef11b566 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1407 microversion: 2.20 time: 0.437425 Jun 27 15:53:50.687572 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 377/746] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:53:50 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1407 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:53:50.730923 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-d8618d19-b432-48aa-a835-fb05866bde95 req-7fca1d71-4bc9-4564-9fe2-b2315704de37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a90fed-157b-47f0-bd62-401e29342025", "name": "network-vif-deleted", "tag": "7f8f5cac-5782-481c-b444-127b88873db3"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:50.764933 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-d8618d19-b432-48aa-a835-fb05866bde95 req-7fca1d71-4bc9-4564-9fe2-b2315704de37 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:50.767657 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-d8618d19-b432-48aa-a835-fb05866bde95 req-7fca1d71-4bc9-4564-9fe2-b2315704de37 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:50.823195 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-d8618d19-b432-48aa-a835-fb05866bde95 req-7fca1d71-4bc9-4564-9fe2-b2315704de37 service nova] Creating event network-vif-deleted:7f8f5cac-5782-481c-b444-127b88873db3 for instance b6a90fed-157b-47f0-bd62-401e29342025 on hv-cinder-84780 Jun 27 15:53:50.862822 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-d8618d19-b432-48aa-a835-fb05866bde95 req-7fca1d71-4bc9-4564-9fe2-b2315704de37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133124 Jun 27 15:53:50.866717 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 370/747] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:53:51.244932 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-8c23d3a0-dc8f-4a9a-b527-1c3a725036e7 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:51.247197 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-8c23d3a0-dc8f-4a9a-b527-1c3a725036e7 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:51.259410 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8c23d3a0-dc8f-4a9a-b527-1c3a725036e7 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:51.260510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8c23d3a0-dc8f-4a9a-b527-1c3a725036e7 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:51.263115 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8c23d3a0-dc8f-4a9a-b527-1c3a725036e7 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:51.264042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8c23d3a0-dc8f-4a9a-b527-1c3a725036e7 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:51.292390 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-8c23d3a0-dc8f-4a9a-b527-1c3a725036e7 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] HTTP exception thrown: Instance b6a90fed-157b-47f0-bd62-401e29342025 could not be found. Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-8c23d3a0-dc8f-4a9a-b527-1c3a725036e7 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Request method failure captured: Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 HTTP/1.1 Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudGzzBw054Nc9abhPFH0qG7lFvyDvvOK1YUA8U7uxWE-o8JlB8KT8dAn12EPY-KZRC7Vj99JG05PLw4JgNl5XZvouQZQZyKDVBaA3LmEEuar-6PgxVD4ZtKxrnhSnDdyiv7QpvDRq8a5zG_wuq8hM3haywiWIrbEPOw1tdj890mDLQA Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: ec9f767e3b4d4fb78f86a611ed9f47c5 Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-TestVolumeBootPattern-34943189 Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:53:51.296097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:53:51.298850 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ec9f767e3b4d4fb78f86a611ed9f47c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ec9f767e3b4d4fb78f86a611ed9f47c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ec9f767e3b4d4fb78f86a611ed9f47c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ec9f767e3b4d4fb78f86a611ed9f47c5", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:53:51.298850 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-TestVolumeBootPattern-34943189 Jun 27 15:53:51.298850 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: ec9f767e3b4d4fb78f86a611ed9f47c5 Jun 27 15:53:51.298850 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-TestVolumeBootPattern-34943189 Jun 27 15:53:51.298850 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-TestVolumeBootPattern-34943189-project Jun 27 15:53:51.298850 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:53:51.298850 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:53:51.298850 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 25024a505319480ab00f4c7e58de600c Jun 27 15:53:51.298850 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-TestVolumeBootPattern-34943189-project Jun 27 15:53:51.298850 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:53:51.298850 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance b6a90fed-157b-47f0-bd62-401e29342025 could not be found. Jun 27 15:53:51.298850 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': 'b6a90fed-157b-47f0-bd62-401e29342025'} Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a90fed-157b-47f0-bd62-401e29342025 could not be found. Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:53:51.301176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:53:51.305312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:53:51.305312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:53:51.305312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:53:51.305312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:53:51.305312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:53:51.305312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:53:51.305312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:53:51.305312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a90fed-157b-47f0-bd62-401e29342025 could not be found. Jun 27 15:53:51.305312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:53:51.305312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:53:51.305312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:53:51.305312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:53:51.305312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:53:51.305312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:53:51.305312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:53:51.305312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:53:51.305312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a90fed-157b-47f0-bd62-401e29342025 could not be found. Jun 27 15:53:51.305312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:53:51.310564 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-8c23d3a0-dc8f-4a9a-b527-1c3a725036e7 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Returning 404 to user: Instance b6a90fed-157b-47f0-bd62-401e29342025 could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:53:51.310564 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-8c23d3a0-dc8f-4a9a-b527-1c3a725036e7 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 404 len: 111 microversion: 2.1 time: 0.061147 Jun 27 15:53:51.310564 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 378/748] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:51 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:53:51.463742 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a604e880-c2e5-4731-9f3e-dd6bff314712 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1744685190", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-121267945", "security_groups": [{"name": "tempest-secgroup-smoke-630239606"}], "block_device_mapping_v2": [{"uuid": "a29a947b-0d2f-4cd7-98aa-b695c7f3cb36", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "baf48a70-9fcf-4c95-9a4f-c0f2d3f641eb"}]}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:51.627434 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.network.neutron [None req-a604e880-c2e5-4731-9f3e-dd6bff314712 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] validate_networks() for [('baf48a70-9fcf-4c95-9a4f-c0f2d3f641eb', None, None, None, None, None)] {{(pid=129472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:53:51.722594 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-1ee370af-0e36-4e3e-8819-db1a085ce7ea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:51.723969 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-1ee370af-0e36-4e3e-8819-db1a085ce7ea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:51.736613 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1ee370af-0e36-4e3e-8819-db1a085ce7ea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:51.737426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1ee370af-0e36-4e3e-8819-db1a085ce7ea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:51.738914 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1ee370af-0e36-4e3e-8819-db1a085ce7ea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:51.739704 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1ee370af-0e36-4e3e-8819-db1a085ce7ea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:52.077869 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-1ee370af-0e36-4e3e-8819-db1a085ce7ea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:52.090589 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-1ee370af-0e36-4e3e-8819-db1a085ce7ea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:52.093058 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-1ee370af-0e36-4e3e-8819-db1a085ce7ea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:52.094876 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-1ee370af-0e36-4e3e-8819-db1a085ce7ea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1407 microversion: 2.20 time: 0.380959 Jun 27 15:53:52.095714 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 379/749] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:53:51 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1407 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:53:52.260932 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-a604e880-c2e5-4731-9f3e-dd6bff314712 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Flavor limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:53:52.262129 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-a604e880-c2e5-4731-9f3e-dd6bff314712 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Image limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:53:52.262731 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-a604e880-c2e5-4731-9f3e-dd6bff314712 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Flavor pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:53:52.262988 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-a604e880-c2e5-4731-9f3e-dd6bff314712 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Image pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:53:52.264106 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-a604e880-c2e5-4731-9f3e-dd6bff314712 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:53:52.276524 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a604e880-c2e5-4731-9f3e-dd6bff314712 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:52.277942 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a604e880-c2e5-4731-9f3e-dd6bff314712 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:52.278897 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a604e880-c2e5-4731-9f3e-dd6bff314712 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:52.279433 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a604e880-c2e5-4731-9f3e-dd6bff314712 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:52.302318 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-a604e880-c2e5-4731-9f3e-dd6bff314712 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Getting quotas for project ec9f767e3b4d4fb78f86a611ed9f47c5. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:53:52.307845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-a604e880-c2e5-4731-9f3e-dd6bff314712 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Getting quotas for user 25024a505319480ab00f4c7e58de600c and project ec9f767e3b4d4fb78f86a611ed9f47c5. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:53:52.392110 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a604e880-c2e5-4731-9f3e-dd6bff314712 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Going to run 1 instances... {{(pid=129472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:53:52.394968 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a604e880-c2e5-4731-9f3e-dd6bff314712 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a29a947b-0d2f-4cd7-98aa-b695c7f3cb36',volume_size=None,volume_type=None)] {{(pid=129472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:53:52.569846 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-a604e880-c2e5-4731-9f3e-dd6bff314712 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.110873 Jun 27 15:53:52.571307 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 371/750] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 15:53:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 15:53:52.586105 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-8b69c2b9-3205-4c34-a588-1b5af4a3c5b4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:52.588200 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-8b69c2b9-3205-4c34-a588-1b5af4a3c5b4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:52.682375 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-8b69c2b9-3205-4c34-a588-1b5af4a3c5b4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:52.690948 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-8b69c2b9-3205-4c34-a588-1b5af4a3c5b4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1094 microversion: 2.1 time: 0.112655 Jun 27 15:53:52.691862 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 380/751] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:52 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1094 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:52.912592 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-074737c1-392b-4cfd-b20c-5e9875085cb1 req-730bf10e-8765-4878-9746-da5a0ffa0505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a5fc50-738a-4228-9733-e9e7b34daccd", "tag": "c7c3302d-ee51-4be2-b345-2ab41cfc76b0"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:52.935936 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-074737c1-392b-4cfd-b20c-5e9875085cb1 req-730bf10e-8765-4878-9746-da5a0ffa0505 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:52.939030 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-074737c1-392b-4cfd-b20c-5e9875085cb1 req-730bf10e-8765-4878-9746-da5a0ffa0505 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:52.973138 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-074737c1-392b-4cfd-b20c-5e9875085cb1 req-730bf10e-8765-4878-9746-da5a0ffa0505 service nova] Creating event network-changed:c7c3302d-ee51-4be2-b345-2ab41cfc76b0 for instance 32a5fc50-738a-4228-9733-e9e7b34daccd on hv-cinder-84780 Jun 27 15:53:52.984660 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-074737c1-392b-4cfd-b20c-5e9875085cb1 req-730bf10e-8765-4878-9746-da5a0ffa0505 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083771 Jun 27 15:53:52.986723 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 372/752] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:53:53.119459 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-01c00e64-cfcb-4064-9148-0a8fa3f7acc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:53.121128 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-01c00e64-cfcb-4064-9148-0a8fa3f7acc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:53.126650 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:53:53.135877 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-01c00e64-cfcb-4064-9148-0a8fa3f7acc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:53.137256 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-01c00e64-cfcb-4064-9148-0a8fa3f7acc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:53.138809 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-01c00e64-cfcb-4064-9148-0a8fa3f7acc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:53.139618 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-01c00e64-cfcb-4064-9148-0a8fa3f7acc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:53.369253 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-01c00e64-cfcb-4064-9148-0a8fa3f7acc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:53.386489 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-01c00e64-cfcb-4064-9148-0a8fa3f7acc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:53.389830 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-01c00e64-cfcb-4064-9148-0a8fa3f7acc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:53.392583 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-01c00e64-cfcb-4064-9148-0a8fa3f7acc6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1407 microversion: 2.20 time: 0.280655 Jun 27 15:53:53.397713 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 381/753] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:53:53 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:53:53.719809 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d24c111d-fa80-417c-96bd-e1b7c12fce75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:53.720519 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d24c111d-fa80-417c-96bd-e1b7c12fce75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:53.727668 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d24c111d-fa80-417c-96bd-e1b7c12fce75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:53.728115 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d24c111d-fa80-417c-96bd-e1b7c12fce75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:53.728901 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d24c111d-fa80-417c-96bd-e1b7c12fce75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:53.729338 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d24c111d-fa80-417c-96bd-e1b7c12fce75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:53.805058 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d24c111d-fa80-417c-96bd-e1b7c12fce75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:53.814146 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d24c111d-fa80-417c-96bd-e1b7c12fce75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1192 microversion: 2.1 time: 0.100038 Jun 27 15:53:53.814744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 373/754] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:53 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1192 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:54.422208 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-94f847f8-af52-47b5-bb02-654bd460a5d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:54.423684 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-94f847f8-af52-47b5-bb02-654bd460a5d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:54.437017 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-94f847f8-af52-47b5-bb02-654bd460a5d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:54.438267 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-94f847f8-af52-47b5-bb02-654bd460a5d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:54.439326 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-94f847f8-af52-47b5-bb02-654bd460a5d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:54.440005 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-94f847f8-af52-47b5-bb02-654bd460a5d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:54.810181 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-94f847f8-af52-47b5-bb02-654bd460a5d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:54.833371 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-94f847f8-af52-47b5-bb02-654bd460a5d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:54.834567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-31318222-46a7-477d-bc1e-651448d1e67b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:54.835332 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-31318222-46a7-477d-bc1e-651448d1e67b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:54.837321 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-94f847f8-af52-47b5-bb02-654bd460a5d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:54.840440 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-94f847f8-af52-47b5-bb02-654bd460a5d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1407 microversion: 2.20 time: 0.422667 Jun 27 15:53:54.841067 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 382/755] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:53:54 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1407 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:53:54.865810 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-31318222-46a7-477d-bc1e-651448d1e67b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:54.867288 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-31318222-46a7-477d-bc1e-651448d1e67b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:54.869850 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-31318222-46a7-477d-bc1e-651448d1e67b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:54.870997 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-31318222-46a7-477d-bc1e-651448d1e67b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:54.999553 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-31318222-46a7-477d-bc1e-651448d1e67b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:55.008751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-31318222-46a7-477d-bc1e-651448d1e67b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1210 microversion: 2.1 time: 0.178313 Jun 27 15:53:55.009692 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 374/756] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:54 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1210 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:55.864871 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-96c87abd-2b4b-49a6-8513-83e6dbe019ab tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:55.866010 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-96c87abd-2b4b-49a6-8513-83e6dbe019ab tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:55.897458 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-96c87abd-2b4b-49a6-8513-83e6dbe019ab tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:55.903255 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-96c87abd-2b4b-49a6-8513-83e6dbe019ab tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:55.913284 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-96c87abd-2b4b-49a6-8513-83e6dbe019ab tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:55.914188 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-96c87abd-2b4b-49a6-8513-83e6dbe019ab tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:56.040042 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c78dd632-b799-4fb4-93b2-23719ca3680d tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:56.041069 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c78dd632-b799-4fb4-93b2-23719ca3680d tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:56.062218 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c78dd632-b799-4fb4-93b2-23719ca3680d tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:56.062995 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c78dd632-b799-4fb4-93b2-23719ca3680d tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:56.064686 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c78dd632-b799-4fb4-93b2-23719ca3680d tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:56.065895 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c78dd632-b799-4fb4-93b2-23719ca3680d tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:56.516062 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-96c87abd-2b4b-49a6-8513-83e6dbe019ab tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:56.547633 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-c78dd632-b799-4fb4-93b2-23719ca3680d tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:56.559746 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c78dd632-b799-4fb4-93b2-23719ca3680d tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1265 microversion: 2.1 time: 0.523422 Jun 27 15:53:56.562671 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 375/757] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:56 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1265 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:56.574507 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-96c87abd-2b4b-49a6-8513-83e6dbe019ab tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:56.579011 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-96c87abd-2b4b-49a6-8513-83e6dbe019ab tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:56.582403 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-96c87abd-2b4b-49a6-8513-83e6dbe019ab tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1407 microversion: 2.20 time: 0.726726 Jun 27 15:53:56.584121 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 383/758] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:53:55 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1407 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:53:56.797167 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-e808832a-e989-43a0-85a4-ed3d36f66f8d tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:56.798661 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-e808832a-e989-43a0-85a4-ed3d36f66f8d tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:56.810660 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e808832a-e989-43a0-85a4-ed3d36f66f8d tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:56.812863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e808832a-e989-43a0-85a4-ed3d36f66f8d tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:56.814956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e808832a-e989-43a0-85a4-ed3d36f66f8d tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:56.816718 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e808832a-e989-43a0-85a4-ed3d36f66f8d tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:56.949426 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-e808832a-e989-43a0-85a4-ed3d36f66f8d tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "POST /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34/action" status: 202 len: 0 microversion: 2.1 time: 0.159563 Jun 27 15:53:56.957346 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 376/759] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 27 15:53:56 2022] POST /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:53:56.972115 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0bef9a29-f2d5-4e5e-8e67-b2e2a32d76c6 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:56.975906 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-0bef9a29-f2d5-4e5e-8e67-b2e2a32d76c6 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:56.992420 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0bef9a29-f2d5-4e5e-8e67-b2e2a32d76c6 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:56.993194 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0bef9a29-f2d5-4e5e-8e67-b2e2a32d76c6 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:56.994470 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0bef9a29-f2d5-4e5e-8e67-b2e2a32d76c6 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:56.995326 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0bef9a29-f2d5-4e5e-8e67-b2e2a32d76c6 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:57.179643 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-324c35e1-3933-4455-a749-fab520935bec req-ba994993-b69d-433a-960c-cbc3d670d326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a7d7777-ce5f-4034-b1b7-2856430ab182", "tag": "04e8591d-d665-4504-be77-3a1e0d3a1940"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:57.206470 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-324c35e1-3933-4455-a749-fab520935bec req-ba994993-b69d-433a-960c-cbc3d670d326 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:57.207447 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-324c35e1-3933-4455-a749-fab520935bec req-ba994993-b69d-433a-960c-cbc3d670d326 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:57.230468 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-324c35e1-3933-4455-a749-fab520935bec req-ba994993-b69d-433a-960c-cbc3d670d326 service nova] Creating event network-changed:04e8591d-d665-4504-be77-3a1e0d3a1940 for instance 0a7d7777-ce5f-4034-b1b7-2856430ab182 on hv-cinder-84780 Jun 27 15:53:57.237628 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-324c35e1-3933-4455-a749-fab520935bec req-ba994993-b69d-433a-960c-cbc3d670d326 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065076 Jun 27 15:53:57.238594 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 377/760] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:53:57.352030 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-0bef9a29-f2d5-4e5e-8e67-b2e2a32d76c6 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:57.372594 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-0bef9a29-f2d5-4e5e-8e67-b2e2a32d76c6 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1750 microversion: 2.1 time: 0.414485 Jun 27 15:53:57.386882 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 384/761] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:56 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1750 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:57.583854 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9b4e660d-d934-41a0-b193-bd2911ec4fd1 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:57.584940 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9b4e660d-d934-41a0-b193-bd2911ec4fd1 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:57.596304 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9b4e660d-d934-41a0-b193-bd2911ec4fd1 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:57.597157 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9b4e660d-d934-41a0-b193-bd2911ec4fd1 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:57.598931 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9b4e660d-d934-41a0-b193-bd2911ec4fd1 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:57.600035 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9b4e660d-d934-41a0-b193-bd2911ec4fd1 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:57.615185 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-714a8e4e-d258-470f-9ae8-a1f570a13cc5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:57.616206 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-714a8e4e-d258-470f-9ae8-a1f570a13cc5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:57.639821 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-714a8e4e-d258-470f-9ae8-a1f570a13cc5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:57.643210 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-714a8e4e-d258-470f-9ae8-a1f570a13cc5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:57.644538 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-714a8e4e-d258-470f-9ae8-a1f570a13cc5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:57.646225 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-714a8e4e-d258-470f-9ae8-a1f570a13cc5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:57.981655 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9b4e660d-d934-41a0-b193-bd2911ec4fd1 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:57.987115 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-714a8e4e-d258-470f-9ae8-a1f570a13cc5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:57.999353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-714a8e4e-d258-470f-9ae8-a1f570a13cc5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:58.000564 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-714a8e4e-d258-470f-9ae8-a1f570a13cc5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:58.001976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-714a8e4e-d258-470f-9ae8-a1f570a13cc5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1407 microversion: 2.20 time: 0.391010 Jun 27 15:53:58.008550 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9b4e660d-d934-41a0-b193-bd2911ec4fd1 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1265 microversion: 2.1 time: 0.431122 Jun 27 15:53:58.010499 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 378/762] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:57 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1265 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:53:58.013385 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 385/763] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:53:57 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:53:58.141272 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-692bf465-e9cf-4fba-a0fa-498e7a05958e req-375590a9-16f4-4c13-a27a-500df79e3225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a5fc50-738a-4228-9733-e9e7b34daccd", "name": "network-vif-plugged", "status": "completed", "tag": "c7c3302d-ee51-4be2-b345-2ab41cfc76b0"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:53:58.175915 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-692bf465-e9cf-4fba-a0fa-498e7a05958e req-375590a9-16f4-4c13-a27a-500df79e3225 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:58.176694 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-692bf465-e9cf-4fba-a0fa-498e7a05958e req-375590a9-16f4-4c13-a27a-500df79e3225 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:58.201102 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-692bf465-e9cf-4fba-a0fa-498e7a05958e req-375590a9-16f4-4c13-a27a-500df79e3225 service nova] Creating event network-vif-plugged:c7c3302d-ee51-4be2-b345-2ab41cfc76b0 for instance 32a5fc50-738a-4228-9733-e9e7b34daccd on hv-cinder-84780 Jun 27 15:53:58.210561 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-692bf465-e9cf-4fba-a0fa-498e7a05958e req-375590a9-16f4-4c13-a27a-500df79e3225 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193583 Jun 27 15:53:58.212532 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 379/764] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:53:58.409456 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d113d4b7-6b69-4a59-a35f-f634fe627257 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:58.420999 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d113d4b7-6b69-4a59-a35f-f634fe627257 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:58.434554 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d113d4b7-6b69-4a59-a35f-f634fe627257 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:58.436052 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d113d4b7-6b69-4a59-a35f-f634fe627257 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:58.437846 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d113d4b7-6b69-4a59-a35f-f634fe627257 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:58.438904 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d113d4b7-6b69-4a59-a35f-f634fe627257 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:58.830071 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d113d4b7-6b69-4a59-a35f-f634fe627257 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:58.865950 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d113d4b7-6b69-4a59-a35f-f634fe627257 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1750 microversion: 2.1 time: 0.467194 Jun 27 15:53:58.887531 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 386/765] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:58 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1750 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:59.026012 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-471973c1-2af0-4b71-9efd-98b3cbcc1df4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:59.028357 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-471973c1-2af0-4b71-9efd-98b3cbcc1df4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:59.028713 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-93616a92-3a63-45e3-afc9-efacdc892c75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:59.030277 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-93616a92-3a63-45e3-afc9-efacdc892c75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:59.039706 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-471973c1-2af0-4b71-9efd-98b3cbcc1df4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:59.040345 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-93616a92-3a63-45e3-afc9-efacdc892c75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:59.040526 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-471973c1-2af0-4b71-9efd-98b3cbcc1df4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:59.041161 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-93616a92-3a63-45e3-afc9-efacdc892c75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:59.042048 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-471973c1-2af0-4b71-9efd-98b3cbcc1df4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:59.042758 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-471973c1-2af0-4b71-9efd-98b3cbcc1df4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:59.042975 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-93616a92-3a63-45e3-afc9-efacdc892c75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:59.043719 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-93616a92-3a63-45e3-afc9-efacdc892c75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:59.079558 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=100 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:53:59.305094 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-93616a92-3a63-45e3-afc9-efacdc892c75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:59.320839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-471973c1-2af0-4b71-9efd-98b3cbcc1df4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:59.336755 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-93616a92-3a63-45e3-afc9-efacdc892c75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1265 microversion: 2.1 time: 0.310191 Jun 27 15:53:59.338716 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 387/766] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:59 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1265 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:53:59.359342 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-471973c1-2af0-4b71-9efd-98b3cbcc1df4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:59.362669 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-471973c1-2af0-4b71-9efd-98b3cbcc1df4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:53:59.364772 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-471973c1-2af0-4b71-9efd-98b3cbcc1df4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1407 microversion: 2.20 time: 0.346930 Jun 27 15:53:59.366140 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 380/767] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:53:59 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1407 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:53:59.899657 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-9d83ea2d-49ae-4676-b060-0de167fa074d tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:53:59.900526 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-9d83ea2d-49ae-4676-b060-0de167fa074d tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:53:59.908909 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9d83ea2d-49ae-4676-b060-0de167fa074d tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:59.909491 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9d83ea2d-49ae-4676-b060-0de167fa074d tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:53:59.910483 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9d83ea2d-49ae-4676-b060-0de167fa074d tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:53:59.911030 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9d83ea2d-49ae-4676-b060-0de167fa074d tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:00.144320 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-9d83ea2d-49ae-4676-b060-0de167fa074d tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:00.159083 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-9d83ea2d-49ae-4676-b060-0de167fa074d tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1755 microversion: 2.1 time: 0.263757 Jun 27 15:54:00.161713 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 388/768] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:53:59 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1755 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:00.358357 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-49e3d193-e92b-44c4-80b8-5aa7a12430c7 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:00.359251 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-49e3d193-e92b-44c4-80b8-5aa7a12430c7 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:00.368808 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-49e3d193-e92b-44c4-80b8-5aa7a12430c7 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:00.369485 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-49e3d193-e92b-44c4-80b8-5aa7a12430c7 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:00.370574 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-49e3d193-e92b-44c4-80b8-5aa7a12430c7 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:00.371113 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-49e3d193-e92b-44c4-80b8-5aa7a12430c7 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:00.403281 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a88e52aa-09fd-4777-bbdc-cf16e27ec295 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:00.404894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a88e52aa-09fd-4777-bbdc-cf16e27ec295 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:00.416956 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a88e52aa-09fd-4777-bbdc-cf16e27ec295 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:00.417823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a88e52aa-09fd-4777-bbdc-cf16e27ec295 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:00.435067 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a88e52aa-09fd-4777-bbdc-cf16e27ec295 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:00.436255 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a88e52aa-09fd-4777-bbdc-cf16e27ec295 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:00.638581 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-49e3d193-e92b-44c4-80b8-5aa7a12430c7 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:00.654080 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-49e3d193-e92b-44c4-80b8-5aa7a12430c7 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1265 microversion: 2.1 time: 0.301292 Jun 27 15:54:00.655755 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 381/769] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:00 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1265 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:00.697209 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a88e52aa-09fd-4777-bbdc-cf16e27ec295 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:00.712188 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a88e52aa-09fd-4777-bbdc-cf16e27ec295 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:00.714913 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a88e52aa-09fd-4777-bbdc-cf16e27ec295 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:00.716554 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a88e52aa-09fd-4777-bbdc-cf16e27ec295 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1599 microversion: 2.20 time: 0.323163 Jun 27 15:54:00.730622 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 389/770] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:54:00 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1599 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:54:00.742753 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-61e76159-6599-4a77-9777-75fee865516e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:00.744562 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-61e76159-6599-4a77-9777-75fee865516e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:00.753146 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-61e76159-6599-4a77-9777-75fee865516e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:00.753735 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-61e76159-6599-4a77-9777-75fee865516e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:00.755113 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-61e76159-6599-4a77-9777-75fee865516e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:00.755813 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-61e76159-6599-4a77-9777-75fee865516e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:00.761521 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:54:00.881021 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-61e76159-6599-4a77-9777-75fee865516e tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.143724 Jun 27 15:54:00.882153 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 382/771] 10.222.0.20 () {60 vars in 1315 bytes} [Mon Jun 27 15:54:00 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:54:01.188498 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-6b8186c5-894d-4cc4-ad91-50c4ebac001b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:01.189379 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-6b8186c5-894d-4cc4-ad91-50c4ebac001b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:01.198203 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6b8186c5-894d-4cc4-ad91-50c4ebac001b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:01.199663 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6b8186c5-894d-4cc4-ad91-50c4ebac001b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:01.202691 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6b8186c5-894d-4cc4-ad91-50c4ebac001b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:01.204531 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6b8186c5-894d-4cc4-ad91-50c4ebac001b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:01.681821 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-be0a63a9-5796-4102-9bcc-ba99f5223a75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:01.685287 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-be0a63a9-5796-4102-9bcc-ba99f5223a75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:01.700865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-be0a63a9-5796-4102-9bcc-ba99f5223a75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:01.702047 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-be0a63a9-5796-4102-9bcc-ba99f5223a75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:01.703923 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-be0a63a9-5796-4102-9bcc-ba99f5223a75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:01.705697 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-be0a63a9-5796-4102-9bcc-ba99f5223a75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:01.758492 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-6b8186c5-894d-4cc4-ad91-50c4ebac001b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:01.793263 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-6b8186c5-894d-4cc4-ad91-50c4ebac001b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1755 microversion: 2.1 time: 0.611208 Jun 27 15:54:01.809707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 390/772] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:01 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1755 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:02.191844 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-be0a63a9-5796-4102-9bcc-ba99f5223a75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:02.213560 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-be0a63a9-5796-4102-9bcc-ba99f5223a75 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1265 microversion: 2.1 time: 0.537520 Jun 27 15:54:02.216131 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 383/773] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:01 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1265 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:02.835987 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b478196d-5158-4633-8d87-e94eab352883 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:02.837113 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b478196d-5158-4633-8d87-e94eab352883 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:02.843380 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=2 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:54:02.862350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-2575ffbf-9b1f-4ca7-841f-2e733cec5cbb req-2d8ef08a-f564-4f96-950f-28b0cc7b7ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a5fc50-738a-4228-9733-e9e7b34daccd", "tag": "c7c3302d-ee51-4be2-b345-2ab41cfc76b0"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:54:02.883945 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b478196d-5158-4633-8d87-e94eab352883 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:02.887566 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b478196d-5158-4633-8d87-e94eab352883 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:02.898769 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b478196d-5158-4633-8d87-e94eab352883 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:02.899548 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b478196d-5158-4633-8d87-e94eab352883 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:02.905872 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=4 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:54:02.907615 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=18 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:54:02.930862 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-2575ffbf-9b1f-4ca7-841f-2e733cec5cbb req-2d8ef08a-f564-4f96-950f-28b0cc7b7ed5 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:02.931519 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-2575ffbf-9b1f-4ca7-841f-2e733cec5cbb req-2d8ef08a-f564-4f96-950f-28b0cc7b7ed5 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:02.952766 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-2575ffbf-9b1f-4ca7-841f-2e733cec5cbb req-2d8ef08a-f564-4f96-950f-28b0cc7b7ed5 service nova] Creating event network-changed:c7c3302d-ee51-4be2-b345-2ab41cfc76b0 for instance 32a5fc50-738a-4228-9733-e9e7b34daccd on hv-cinder-84780 Jun 27 15:54:02.961417 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-2575ffbf-9b1f-4ca7-841f-2e733cec5cbb req-2d8ef08a-f564-4f96-950f-28b0cc7b7ed5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106733 Jun 27 15:54:02.967638 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 384/774] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:54:03.249819 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b478196d-5158-4633-8d87-e94eab352883 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:03.250633 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-e257309c-d0b6-447f-8256-765d0f0e08cc tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:03.252359 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-e257309c-d0b6-447f-8256-765d0f0e08cc tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:03.264291 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e257309c-d0b6-447f-8256-765d0f0e08cc tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:03.265388 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e257309c-d0b6-447f-8256-765d0f0e08cc tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:03.267102 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e257309c-d0b6-447f-8256-765d0f0e08cc tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:03.268269 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e257309c-d0b6-447f-8256-765d0f0e08cc tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:03.279829 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b478196d-5158-4633-8d87-e94eab352883 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1755 microversion: 2.1 time: 0.451134 Jun 27 15:54:03.284153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 391/775] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:02 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1755 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:03.508150 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-e257309c-d0b6-447f-8256-765d0f0e08cc tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:03.521706 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-e257309c-d0b6-447f-8256-765d0f0e08cc tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1265 microversion: 2.1 time: 0.284314 Jun 27 15:54:03.534101 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 385/776] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:03 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:04.314803 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-782f23e0-413a-464d-970c-484d7ff0cb05 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:04.318077 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-782f23e0-413a-464d-970c-484d7ff0cb05 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:04.329164 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-782f23e0-413a-464d-970c-484d7ff0cb05 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:04.330080 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-782f23e0-413a-464d-970c-484d7ff0cb05 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:04.331700 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-782f23e0-413a-464d-970c-484d7ff0cb05 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:04.332546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-782f23e0-413a-464d-970c-484d7ff0cb05 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:04.544940 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-b6c35371-235b-4254-9aa0-6ce26761ae05 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:04.551367 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-b6c35371-235b-4254-9aa0-6ce26761ae05 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:04.566906 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b6c35371-235b-4254-9aa0-6ce26761ae05 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:04.570756 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b6c35371-235b-4254-9aa0-6ce26761ae05 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:04.571877 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b6c35371-235b-4254-9aa0-6ce26761ae05 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:04.572437 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b6c35371-235b-4254-9aa0-6ce26761ae05 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:04.596903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-782f23e0-413a-464d-970c-484d7ff0cb05 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:04.609741 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-782f23e0-413a-464d-970c-484d7ff0cb05 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1755 microversion: 2.1 time: 0.303437 Jun 27 15:54:04.615464 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 392/777] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:04 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1755 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:04.836578 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b6c35371-235b-4254-9aa0-6ce26761ae05 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:04.848804 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-b6c35371-235b-4254-9aa0-6ce26761ae05 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1265 microversion: 2.1 time: 0.311350 Jun 27 15:54:04.850198 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 386/778] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:04 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1265 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:05.638907 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d34cf2b4-bc45-45dd-a413-9d45960749f2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:05.641097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d34cf2b4-bc45-45dd-a413-9d45960749f2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:05.654600 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d34cf2b4-bc45-45dd-a413-9d45960749f2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:05.655787 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d34cf2b4-bc45-45dd-a413-9d45960749f2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:05.657431 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d34cf2b4-bc45-45dd-a413-9d45960749f2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:05.658544 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d34cf2b4-bc45-45dd-a413-9d45960749f2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:05.875553 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3f0e9d0e-49fd-4229-9b7b-b7f27cfb2de8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:05.879536 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3f0e9d0e-49fd-4229-9b7b-b7f27cfb2de8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:05.900976 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3f0e9d0e-49fd-4229-9b7b-b7f27cfb2de8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:05.902967 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3f0e9d0e-49fd-4229-9b7b-b7f27cfb2de8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:05.904776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3f0e9d0e-49fd-4229-9b7b-b7f27cfb2de8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:05.906278 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3f0e9d0e-49fd-4229-9b7b-b7f27cfb2de8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:05.945410 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d34cf2b4-bc45-45dd-a413-9d45960749f2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:05.971214 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d34cf2b4-bc45-45dd-a413-9d45960749f2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1755 microversion: 2.1 time: 0.339931 Jun 27 15:54:05.986430 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 393/779] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:05 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1755 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:06.171359 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3f0e9d0e-49fd-4229-9b7b-b7f27cfb2de8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:06.184829 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3f0e9d0e-49fd-4229-9b7b-b7f27cfb2de8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1265 microversion: 2.1 time: 0.320253 Jun 27 15:54:06.185876 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 387/780] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:05 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1265 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:07.005322 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f0e4e62c-6383-4898-8e8f-68b30ad62288 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:07.008273 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f0e4e62c-6383-4898-8e8f-68b30ad62288 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:07.023569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f0e4e62c-6383-4898-8e8f-68b30ad62288 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:07.024559 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f0e4e62c-6383-4898-8e8f-68b30ad62288 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:07.026308 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f0e4e62c-6383-4898-8e8f-68b30ad62288 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:07.027491 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f0e4e62c-6383-4898-8e8f-68b30ad62288 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:07.207915 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-4dbcf6bc-94f7-447d-a139-5a75b2ea196c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:07.209086 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-4dbcf6bc-94f7-447d-a139-5a75b2ea196c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:07.235062 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4dbcf6bc-94f7-447d-a139-5a75b2ea196c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:07.247014 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4dbcf6bc-94f7-447d-a139-5a75b2ea196c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:07.247014 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4dbcf6bc-94f7-447d-a139-5a75b2ea196c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:07.247014 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4dbcf6bc-94f7-447d-a139-5a75b2ea196c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:07.322747 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f0e4e62c-6383-4898-8e8f-68b30ad62288 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:07.351123 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f0e4e62c-6383-4898-8e8f-68b30ad62288 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1755 microversion: 2.1 time: 0.354397 Jun 27 15:54:07.352738 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 394/781] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:06 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1755 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:07.519941 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-4dbcf6bc-94f7-447d-a139-5a75b2ea196c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:07.530968 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-4dbcf6bc-94f7-447d-a139-5a75b2ea196c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1265 microversion: 2.1 time: 0.330239 Jun 27 15:54:07.542757 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 388/782] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:07 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1265 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:54:08.376691 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-664624bd-2c8e-4da5-ae18-ec1b04c4999f tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:08.377882 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-664624bd-2c8e-4da5-ae18-ec1b04c4999f tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:08.389981 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-664624bd-2c8e-4da5-ae18-ec1b04c4999f tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:08.390906 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-664624bd-2c8e-4da5-ae18-ec1b04c4999f tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:08.392337 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-664624bd-2c8e-4da5-ae18-ec1b04c4999f tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:08.392975 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-664624bd-2c8e-4da5-ae18-ec1b04c4999f tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:08.556761 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-65ccbc4d-1646-490f-9d25-efcb194f0f71 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:08.557680 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-65ccbc4d-1646-490f-9d25-efcb194f0f71 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:08.567847 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-65ccbc4d-1646-490f-9d25-efcb194f0f71 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:08.568404 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-65ccbc4d-1646-490f-9d25-efcb194f0f71 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:08.569588 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-65ccbc4d-1646-490f-9d25-efcb194f0f71 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:08.570158 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-65ccbc4d-1646-490f-9d25-efcb194f0f71 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:08.641979 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-664624bd-2c8e-4da5-ae18-ec1b04c4999f tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:08.651019 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-664624bd-2c8e-4da5-ae18-ec1b04c4999f tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1755 microversion: 2.1 time: 0.280635 Jun 27 15:54:08.652493 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 395/783] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:08 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1755 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:54:08.768102 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-65ccbc4d-1646-490f-9d25-efcb194f0f71 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:08.784299 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-65ccbc4d-1646-490f-9d25-efcb194f0f71 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1265 microversion: 2.1 time: 0.236455 Jun 27 15:54:08.785345 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 389/784] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:08 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:54:08.806803 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-bc053c1c-274a-4201-8f9a-6aa556018242 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Action: 'create', calling method: .version_select at 0x7fe146483820>, body: {"keypair": {"name": "tempest-keypair-1735451729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3oVm7mxIVCfEhqo1AVxInIWaMecGdzkbFKQZab9O3z4sUw3iMvKwWHTOMDxIR6gk1VSgjGBKQ7JIUzEgZ7grrrD+ltbMFLVAFNiIQVHNCrF415QSn5QajoTIpckJbepA=="}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:54:08.836412 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-bc053c1c-274a-4201-8f9a-6aa556018242 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Getting quotas for project 90d9fb4d2e024e6eac7eeee72e63e904. Resources: {'key_pairs'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:54:08.851803 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-bc053c1c-274a-4201-8f9a-6aa556018242 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Getting quotas for user ce59e0072f1c4b91a2825e5fecde7e23 and project 90d9fb4d2e024e6eac7eeee72e63e904. Resources: {'key_pairs'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:54:08.900861 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-bc053c1c-274a-4201-8f9a-6aa556018242 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.246679 Jun 27 15:54:08.902105 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 396/785] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 27 15:54:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:54:09.675922 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-826ea6bb-bf39-4cf7-ac6d-962edba9f241 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:09.677079 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-826ea6bb-bf39-4cf7-ac6d-962edba9f241 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:09.691731 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-826ea6bb-bf39-4cf7-ac6d-962edba9f241 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:09.693062 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-826ea6bb-bf39-4cf7-ac6d-962edba9f241 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:09.694555 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-826ea6bb-bf39-4cf7-ac6d-962edba9f241 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:09.695361 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-826ea6bb-bf39-4cf7-ac6d-962edba9f241 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:09.812111 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-5d92d0e6-a5ba-405e-987e-e475649c0ee5 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:09.814322 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-5d92d0e6-a5ba-405e-987e-e475649c0ee5 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:09.829877 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5d92d0e6-a5ba-405e-987e-e475649c0ee5 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:09.831331 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5d92d0e6-a5ba-405e-987e-e475649c0ee5 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:09.833123 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5d92d0e6-a5ba-405e-987e-e475649c0ee5 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:09.834219 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5d92d0e6-a5ba-405e-987e-e475649c0ee5 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:10.227583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-826ea6bb-bf39-4cf7-ac6d-962edba9f241 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:10.244159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-826ea6bb-bf39-4cf7-ac6d-962edba9f241 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1755 microversion: 2.1 time: 0.576929 Jun 27 15:54:10.247907 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 390/786] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:09 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1755 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:10.255009 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-5d92d0e6-a5ba-405e-987e-e475649c0ee5 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:10.271716 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-5d92d0e6-a5ba-405e-987e-e475649c0ee5 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1265 microversion: 2.1 time: 0.471957 Jun 27 15:54:10.272700 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 397/787] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:09 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1265 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:11.166005 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-686274ae-4ea7-4547-baf8-a99d89388929 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1267791196", "imageRef": "11f9be98-90d6-4c67-8d66-0b944f5a2a2b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db23eeee-31f0-406e-a989-356a481d9808"}], "security_groups": [{"name": "tempest-securitygroup--1216710776"}], "key_name": "tempest-keypair-1735451729", "user_data": "}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:54:11.274089 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-13bddf8d-9313-4e8f-826b-dbdeb895690c tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:11.275401 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-13bddf8d-9313-4e8f-826b-dbdeb895690c tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:11.283634 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-13bddf8d-9313-4e8f-826b-dbdeb895690c tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:11.284561 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-13bddf8d-9313-4e8f-826b-dbdeb895690c tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:11.285620 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-13bddf8d-9313-4e8f-826b-dbdeb895690c tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:11.286251 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-13bddf8d-9313-4e8f-826b-dbdeb895690c tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:11.724587 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.network.neutron [None req-686274ae-4ea7-4547-baf8-a99d89388929 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] validate_networks() for [('db23eeee-31f0-406e-a989-356a481d9808', None, None, None, None, None)] {{(pid=129472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:54:12.050939 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-13bddf8d-9313-4e8f-826b-dbdeb895690c tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:12.064536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-13bddf8d-9313-4e8f-826b-dbdeb895690c tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1755 microversion: 2.1 time: 0.794812 Jun 27 15:54:12.065863 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 398/788] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:11 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1755 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:12.083369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3d4f3850-ffef-493c-ab2e-0817650e2457 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:12.084169 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3d4f3850-ffef-493c-ab2e-0817650e2457 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:12.092966 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3d4f3850-ffef-493c-ab2e-0817650e2457 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:12.094250 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3d4f3850-ffef-493c-ab2e-0817650e2457 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:12.096555 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3d4f3850-ffef-493c-ab2e-0817650e2457 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:12.097249 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3d4f3850-ffef-493c-ab2e-0817650e2457 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:12.375984 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3d4f3850-ffef-493c-ab2e-0817650e2457 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:12.393208 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3d4f3850-ffef-493c-ab2e-0817650e2457 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1265 microversion: 2.1 time: 0.325668 Jun 27 15:54:12.394727 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 399/789] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:12 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1265 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:12.404735 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-beee6bd5-020e-41b8-91b2-7c9d92d9f38c req-97c780de-1fb8-44e3-a116-dbcd9ef0954e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a7d7777-ce5f-4034-b1b7-2856430ab182", "name": "network-vif-plugged", "status": "completed", "tag": "04e8591d-d665-4504-be77-3a1e0d3a1940"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:54:12.423219 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-beee6bd5-020e-41b8-91b2-7c9d92d9f38c req-97c780de-1fb8-44e3-a116-dbcd9ef0954e service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:12.424184 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-beee6bd5-020e-41b8-91b2-7c9d92d9f38c req-97c780de-1fb8-44e3-a116-dbcd9ef0954e service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:12.446114 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-beee6bd5-020e-41b8-91b2-7c9d92d9f38c req-97c780de-1fb8-44e3-a116-dbcd9ef0954e service nova] Creating event network-vif-plugged:04e8591d-d665-4504-be77-3a1e0d3a1940 for instance 0a7d7777-ce5f-4034-b1b7-2856430ab182 on hv-cinder-84780 Jun 27 15:54:12.457321 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-beee6bd5-020e-41b8-91b2-7c9d92d9f38c req-97c780de-1fb8-44e3-a116-dbcd9ef0954e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059993 Jun 27 15:54:12.458950 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-686274ae-4ea7-4547-baf8-a99d89388929 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Flavor limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:54:12.459463 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 400/790] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:54:12.460067 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-686274ae-4ea7-4547-baf8-a99d89388929 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Image limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:54:12.460926 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-686274ae-4ea7-4547-baf8-a99d89388929 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Flavor pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:54:12.461249 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-686274ae-4ea7-4547-baf8-a99d89388929 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Image pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:54:12.461547 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-686274ae-4ea7-4547-baf8-a99d89388929 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:54:12.475947 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-686274ae-4ea7-4547-baf8-a99d89388929 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:12.476608 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-686274ae-4ea7-4547-baf8-a99d89388929 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:12.477594 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-686274ae-4ea7-4547-baf8-a99d89388929 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:12.478220 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-686274ae-4ea7-4547-baf8-a99d89388929 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:12.500452 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-686274ae-4ea7-4547-baf8-a99d89388929 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Getting quotas for project 90d9fb4d2e024e6eac7eeee72e63e904. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:54:12.505377 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-686274ae-4ea7-4547-baf8-a99d89388929 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Getting quotas for user ce59e0072f1c4b91a2825e5fecde7e23 and project 90d9fb4d2e024e6eac7eeee72e63e904. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:54:12.527821 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-686274ae-4ea7-4547-baf8-a99d89388929 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Going to run 1 instances... {{(pid=129472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:54:12.534643 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-686274ae-4ea7-4547-baf8-a99d89388929 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11f9be98-90d6-4c67-8d66-0b944f5a2a2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:54:12.647322 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-686274ae-4ea7-4547-baf8-a99d89388929 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.485308 Jun 27 15:54:12.648177 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 391/791] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 15:54:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 15:54:12.669085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b79d1b87-eab9-4dc7-8081-3d04153c0453 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:12.670604 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b79d1b87-eab9-4dc7-8081-3d04153c0453 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:12.770947 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b79d1b87-eab9-4dc7-8081-3d04153c0453 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:12.784352 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b79d1b87-eab9-4dc7-8081-3d04153c0453 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 200 len: 1242 microversion: 2.1 time: 0.123876 Jun 27 15:54:12.785451 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 401/792] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:12 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 1242 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:13.094779 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-2c87abfb-07b4-47b3-9c92-32d41f9bdd53 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:13.096436 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-2c87abfb-07b4-47b3-9c92-32d41f9bdd53 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:13.105224 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2c87abfb-07b4-47b3-9c92-32d41f9bdd53 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:13.106056 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2c87abfb-07b4-47b3-9c92-32d41f9bdd53 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:13.106893 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2c87abfb-07b4-47b3-9c92-32d41f9bdd53 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:13.107468 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2c87abfb-07b4-47b3-9c92-32d41f9bdd53 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:13.307062 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-2c87abfb-07b4-47b3-9c92-32d41f9bdd53 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:13.326952 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-2c87abfb-07b4-47b3-9c92-32d41f9bdd53 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1758 microversion: 2.1 time: 0.239314 Jun 27 15:54:13.328151 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 392/793] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:13 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1758 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:13.412887 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-760035f7-2c78-407f-a704-1709d7d7a07a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:13.413549 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-760035f7-2c78-407f-a704-1709d7d7a07a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:13.423515 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-760035f7-2c78-407f-a704-1709d7d7a07a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:13.423971 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-760035f7-2c78-407f-a704-1709d7d7a07a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:13.424860 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-760035f7-2c78-407f-a704-1709d7d7a07a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:13.425298 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-760035f7-2c78-407f-a704-1709d7d7a07a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:13.613732 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-760035f7-2c78-407f-a704-1709d7d7a07a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:13.626398 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-760035f7-2c78-407f-a704-1709d7d7a07a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1265 microversion: 2.1 time: 0.217535 Jun 27 15:54:13.627104 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 402/794] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:13 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:54:13.807384 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-447ce224-4e00-49e2-aa17-3c7d704fc110 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:13.808616 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-447ce224-4e00-49e2-aa17-3c7d704fc110 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:13.829000 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-447ce224-4e00-49e2-aa17-3c7d704fc110 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:13.829972 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-447ce224-4e00-49e2-aa17-3c7d704fc110 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:13.831744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-447ce224-4e00-49e2-aa17-3c7d704fc110 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:13.832518 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-447ce224-4e00-49e2-aa17-3c7d704fc110 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:13.943958 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-447ce224-4e00-49e2-aa17-3c7d704fc110 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:13.954891 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-447ce224-4e00-49e2-aa17-3c7d704fc110 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 200 len: 1246 microversion: 2.1 time: 0.154593 Jun 27 15:54:13.956081 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 393/795] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:13 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 1246 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:14.646335 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-75dda931-70f1-4e52-a183-0acf8ca3052f tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:14.647373 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-75dda931-70f1-4e52-a183-0acf8ca3052f tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:14.656370 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-75dda931-70f1-4e52-a183-0acf8ca3052f tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:14.657041 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-75dda931-70f1-4e52-a183-0acf8ca3052f tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:14.658013 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-75dda931-70f1-4e52-a183-0acf8ca3052f tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:14.658700 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-75dda931-70f1-4e52-a183-0acf8ca3052f tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:14.874075 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-75dda931-70f1-4e52-a183-0acf8ca3052f tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:14.882641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-75dda931-70f1-4e52-a183-0acf8ca3052f tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1265 microversion: 2.1 time: 0.240874 Jun 27 15:54:14.883415 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 403/796] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:14 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:14.984004 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d94b3b6a-9e95-42c4-b806-574b157733e3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:14.984604 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d94b3b6a-9e95-42c4-b806-574b157733e3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:14.987266 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:54:14.993408 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d94b3b6a-9e95-42c4-b806-574b157733e3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:14.993924 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d94b3b6a-9e95-42c4-b806-574b157733e3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:14.995271 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d94b3b6a-9e95-42c4-b806-574b157733e3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:14.995698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d94b3b6a-9e95-42c4-b806-574b157733e3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:15.080375 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d94b3b6a-9e95-42c4-b806-574b157733e3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:15.094650 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d94b3b6a-9e95-42c4-b806-574b157733e3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 200 len: 1294 microversion: 2.1 time: 0.114814 Jun 27 15:54:15.095548 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 394/797] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:14 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 1294 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:15.902496 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e314ed46-dce1-476b-b069-cffe92338050 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:15.903684 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e314ed46-dce1-476b-b069-cffe92338050 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:15.912112 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e314ed46-dce1-476b-b069-cffe92338050 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:15.912822 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e314ed46-dce1-476b-b069-cffe92338050 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:15.914112 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e314ed46-dce1-476b-b069-cffe92338050 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:15.914642 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e314ed46-dce1-476b-b069-cffe92338050 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:16.105798 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e314ed46-dce1-476b-b069-cffe92338050 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:16.122844 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-767a370d-bbcf-44bf-b973-ea70f1e7b44a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:16.131708 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-767a370d-bbcf-44bf-b973-ea70f1e7b44a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:16.143128 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e314ed46-dce1-476b-b069-cffe92338050 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1451 microversion: 2.1 time: 0.245710 Jun 27 15:54:16.147137 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 404/798] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:15 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1451 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:16.151970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-767a370d-bbcf-44bf-b973-ea70f1e7b44a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:16.153192 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-767a370d-bbcf-44bf-b973-ea70f1e7b44a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:16.155197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-767a370d-bbcf-44bf-b973-ea70f1e7b44a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:16.156146 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-767a370d-bbcf-44bf-b973-ea70f1e7b44a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:16.191386 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-cb9365f8-bf8d-43b7-ae90-d587dcb1c147 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:16.193392 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-cb9365f8-bf8d-43b7-ae90-d587dcb1c147 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:16.207125 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cb9365f8-bf8d-43b7-ae90-d587dcb1c147 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:16.207821 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cb9365f8-bf8d-43b7-ae90-d587dcb1c147 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:16.208466 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cb9365f8-bf8d-43b7-ae90-d587dcb1c147 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:16.208907 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cb9365f8-bf8d-43b7-ae90-d587dcb1c147 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:16.415958 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-767a370d-bbcf-44bf-b973-ea70f1e7b44a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:16.433217 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-767a370d-bbcf-44bf-b973-ea70f1e7b44a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 200 len: 1368 microversion: 2.1 time: 0.314593 Jun 27 15:54:16.435432 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 395/799] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:16 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 1368 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:16.461847 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-17fa6484-7bd7-4b3b-90b8-9fbf4b88c4fb tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:16.463394 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-17fa6484-7bd7-4b3b-90b8-9fbf4b88c4fb tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:16.475865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-17fa6484-7bd7-4b3b-90b8-9fbf4b88c4fb tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:16.477075 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-17fa6484-7bd7-4b3b-90b8-9fbf4b88c4fb tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:16.480235 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-17fa6484-7bd7-4b3b-90b8-9fbf4b88c4fb tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:16.481547 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-17fa6484-7bd7-4b3b-90b8-9fbf4b88c4fb tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:16.508628 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-cb9365f8-bf8d-43b7-ae90-d587dcb1c147 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:16.519961 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-cb9365f8-bf8d-43b7-ae90-d587dcb1c147 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1451 microversion: 2.1 time: 0.343636 Jun 27 15:54:16.530377 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 405/800] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:16 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1451 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:16.544171 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-17fa6484-7bd7-4b3b-90b8-9fbf4b88c4fb tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/ips" status: 200 len: 147 microversion: 2.1 time: 0.088394 Jun 27 15:54:16.553843 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 396/801] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 27 15:54:16 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/ips => generated 147 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:54:17.418977 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-1a5e9642-b584-456a-9201-85e2d4c327c7 req-d9101f8f-797b-4352-bebd-5f8e04f24fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f74d93df-6aac-45ba-83a0-4bafe2c375aa", "tag": "fef1e9fb-3e92-48c7-9b07-aaf3cd512ad4"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:54:17.465686 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9e564e54-e6a2-45b2-9cb8-05b3f2a893ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:17.470728 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9e564e54-e6a2-45b2-9cb8-05b3f2a893ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:17.473275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-1a5e9642-b584-456a-9201-85e2d4c327c7 req-d9101f8f-797b-4352-bebd-5f8e04f24fe8 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:17.482645 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-1a5e9642-b584-456a-9201-85e2d4c327c7 req-d9101f8f-797b-4352-bebd-5f8e04f24fe8 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:17.499398 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9e564e54-e6a2-45b2-9cb8-05b3f2a893ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:17.508084 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9e564e54-e6a2-45b2-9cb8-05b3f2a893ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:17.509679 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9e564e54-e6a2-45b2-9cb8-05b3f2a893ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:17.511212 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9e564e54-e6a2-45b2-9cb8-05b3f2a893ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:17.527247 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-1a5e9642-b584-456a-9201-85e2d4c327c7 req-d9101f8f-797b-4352-bebd-5f8e04f24fe8 service nova] Creating event network-changed:fef1e9fb-3e92-48c7-9b07-aaf3cd512ad4 for instance f74d93df-6aac-45ba-83a0-4bafe2c375aa on hv-cinder-84780 Jun 27 15:54:17.543215 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-1a5e9642-b584-456a-9201-85e2d4c327c7 req-d9101f8f-797b-4352-bebd-5f8e04f24fe8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132559 Jun 27 15:54:17.545267 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 406/802] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:54:17.831634 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9e564e54-e6a2-45b2-9cb8-05b3f2a893ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:17.845965 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9e564e54-e6a2-45b2-9cb8-05b3f2a893ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 200 len: 1368 microversion: 2.1 time: 0.388870 Jun 27 15:54:17.847417 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 397/803] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:17 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 1368 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:54:18.129670 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-004e0ea8-199f-469c-b112-ca5a97d0452c tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90a9cbb4-36cf-40da-89e5-880c36ed15b5"}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:54:18.131733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-004e0ea8-199f-469c-b112-ca5a97d0452c tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:18.143111 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-004e0ea8-199f-469c-b112-ca5a97d0452c tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:18.144387 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-004e0ea8-199f-469c-b112-ca5a97d0452c tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:18.145825 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-004e0ea8-199f-469c-b112-ca5a97d0452c tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:18.146584 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-004e0ea8-199f-469c-b112-ca5a97d0452c tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:18.179404 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=100 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:54:18.874134 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ed7d951d-5742-48ed-a3c3-ecb304cea64f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:18.875149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-ed7d951d-5742-48ed-a3c3-ecb304cea64f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:18.884724 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ed7d951d-5742-48ed-a3c3-ecb304cea64f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:18.885448 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ed7d951d-5742-48ed-a3c3-ecb304cea64f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:18.886881 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ed7d951d-5742-48ed-a3c3-ecb304cea64f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:18.887386 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ed7d951d-5742-48ed-a3c3-ecb304cea64f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:19.139819 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ed7d951d-5742-48ed-a3c3-ecb304cea64f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:19.149793 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ed7d951d-5742-48ed-a3c3-ecb304cea64f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 200 len: 1368 microversion: 2.1 time: 0.282774 Jun 27 15:54:19.157689 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 398/804] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:18 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 1368 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:54:19.157689 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-fc50b863-d0fe-4ad9-9e51-ba2a30272a28 req-1cf749ec-23ce-4288-86e0-1fa33422dfde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a7d7777-ce5f-4034-b1b7-2856430ab182", "tag": "04e8591d-d665-4504-be77-3a1e0d3a1940"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:54:19.165894 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-fc50b863-d0fe-4ad9-9e51-ba2a30272a28 req-1cf749ec-23ce-4288-86e0-1fa33422dfde service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:19.166419 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-fc50b863-d0fe-4ad9-9e51-ba2a30272a28 req-1cf749ec-23ce-4288-86e0-1fa33422dfde service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:19.181895 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-fc50b863-d0fe-4ad9-9e51-ba2a30272a28 req-1cf749ec-23ce-4288-86e0-1fa33422dfde service nova] Creating event network-changed:04e8591d-d665-4504-be77-3a1e0d3a1940 for instance 0a7d7777-ce5f-4034-b1b7-2856430ab182 on hv-cinder-84780 Jun 27 15:54:19.189913 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-fc50b863-d0fe-4ad9-9e51-ba2a30272a28 req-1cf749ec-23ce-4288-86e0-1fa33422dfde service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038025 Jun 27 15:54:19.190531 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 399/805] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:54:19.418723 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-004e0ea8-199f-469c-b112-ca5a97d0452c tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "POST /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.292582 Jun 27 15:54:19.419574 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 407/806] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 27 15:54:18 2022] POST /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments => generated 194 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:54:20.179842 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-577f3b9c-83aa-4daf-8c36-730c69dd09b5 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:20.181387 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-577f3b9c-83aa-4daf-8c36-730c69dd09b5 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:20.195203 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-577f3b9c-83aa-4daf-8c36-730c69dd09b5 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:20.196584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-577f3b9c-83aa-4daf-8c36-730c69dd09b5 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:20.199149 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-577f3b9c-83aa-4daf-8c36-730c69dd09b5 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:20.200154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-577f3b9c-83aa-4daf-8c36-730c69dd09b5 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:20.435374 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-577f3b9c-83aa-4daf-8c36-730c69dd09b5 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:20.445747 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-577f3b9c-83aa-4daf-8c36-730c69dd09b5 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 200 len: 1368 microversion: 2.1 time: 0.273028 Jun 27 15:54:20.447172 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 400/807] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:20 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 1368 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:21.469795 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b5bdea83-3b29-42a7-a6a7-e780dec21a3b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:21.471043 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b5bdea83-3b29-42a7-a6a7-e780dec21a3b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:21.484017 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b5bdea83-3b29-42a7-a6a7-e780dec21a3b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:21.484828 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b5bdea83-3b29-42a7-a6a7-e780dec21a3b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:21.486322 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b5bdea83-3b29-42a7-a6a7-e780dec21a3b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:21.487118 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b5bdea83-3b29-42a7-a6a7-e780dec21a3b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:21.694052 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b5bdea83-3b29-42a7-a6a7-e780dec21a3b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:21.708213 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b5bdea83-3b29-42a7-a6a7-e780dec21a3b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 200 len: 1368 microversion: 2.1 time: 0.246763 Jun 27 15:54:21.709285 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 408/808] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:21 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:22.735441 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-882ea4f1-22d7-49fc-940c-7058f0111082 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:22.736343 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-882ea4f1-22d7-49fc-940c-7058f0111082 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:22.739207 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=2 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:54:22.739906 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=6 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:54:22.747276 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-882ea4f1-22d7-49fc-940c-7058f0111082 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:22.747719 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-882ea4f1-22d7-49fc-940c-7058f0111082 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:22.748549 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-882ea4f1-22d7-49fc-940c-7058f0111082 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:22.749136 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-882ea4f1-22d7-49fc-940c-7058f0111082 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:22.941794 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=100 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:54:23.088156 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-882ea4f1-22d7-49fc-940c-7058f0111082 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:23.097207 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-882ea4f1-22d7-49fc-940c-7058f0111082 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 200 len: 1368 microversion: 2.1 time: 0.367934 Jun 27 15:54:23.098040 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 401/809] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:22 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 1368 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:23.552089 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-eaa8d370-319f-41cb-8229-1be573c113b5 req-f5574a70-7f1b-44f6-9078-ee60f95b4bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f74d93df-6aac-45ba-83a0-4bafe2c375aa", "name": "network-vif-plugged", "status": "completed", "tag": "fef1e9fb-3e92-48c7-9b07-aaf3cd512ad4"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:54:23.557966 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=6 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:54:23.559026 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:54:23.567965 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-eaa8d370-319f-41cb-8229-1be573c113b5 req-f5574a70-7f1b-44f6-9078-ee60f95b4bed service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:23.568623 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-eaa8d370-319f-41cb-8229-1be573c113b5 req-f5574a70-7f1b-44f6-9078-ee60f95b4bed service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:23.585001 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-eaa8d370-319f-41cb-8229-1be573c113b5 req-f5574a70-7f1b-44f6-9078-ee60f95b4bed service nova] Creating event network-vif-plugged:fef1e9fb-3e92-48c7-9b07-aaf3cd512ad4 for instance f74d93df-6aac-45ba-83a0-4bafe2c375aa on hv-cinder-84780 Jun 27 15:54:23.591687 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-eaa8d370-319f-41cb-8229-1be573c113b5 req-f5574a70-7f1b-44f6-9078-ee60f95b4bed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043924 Jun 27 15:54:23.592486 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 409/810] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:54:24.116509 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c1a7ad4e-bb0f-43a1-b909-52bb2e8450f1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:24.117110 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c1a7ad4e-bb0f-43a1-b909-52bb2e8450f1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:24.125451 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c1a7ad4e-bb0f-43a1-b909-52bb2e8450f1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:24.125989 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c1a7ad4e-bb0f-43a1-b909-52bb2e8450f1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:24.126988 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c1a7ad4e-bb0f-43a1-b909-52bb2e8450f1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:24.127467 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c1a7ad4e-bb0f-43a1-b909-52bb2e8450f1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:24.276510 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-c1a7ad4e-bb0f-43a1-b909-52bb2e8450f1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:24.284934 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c1a7ad4e-bb0f-43a1-b909-52bb2e8450f1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 200 len: 1368 microversion: 2.1 time: 0.172645 Jun 27 15:54:24.285512 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 402/811] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:24 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:25.304398 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-8f179dca-b72f-474f-9e1f-7cafad6ee001 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:25.305109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-8f179dca-b72f-474f-9e1f-7cafad6ee001 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:25.313762 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8f179dca-b72f-474f-9e1f-7cafad6ee001 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:25.314213 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8f179dca-b72f-474f-9e1f-7cafad6ee001 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:25.315001 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8f179dca-b72f-474f-9e1f-7cafad6ee001 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:25.315438 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8f179dca-b72f-474f-9e1f-7cafad6ee001 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:25.516398 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-8f179dca-b72f-474f-9e1f-7cafad6ee001 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:25.525088 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-8f179dca-b72f-474f-9e1f-7cafad6ee001 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 200 len: 1368 microversion: 2.1 time: 0.225240 Jun 27 15:54:25.525825 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 410/812] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:25 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:26.546435 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-1bb59a48-cfd2-4ee9-9cc3-9a1dfecfb383 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:26.547610 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-1bb59a48-cfd2-4ee9-9cc3-9a1dfecfb383 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:26.555347 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1bb59a48-cfd2-4ee9-9cc3-9a1dfecfb383 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:26.555811 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1bb59a48-cfd2-4ee9-9cc3-9a1dfecfb383 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:26.556620 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1bb59a48-cfd2-4ee9-9cc3-9a1dfecfb383 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:26.557566 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1bb59a48-cfd2-4ee9-9cc3-9a1dfecfb383 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:26.758800 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-1bb59a48-cfd2-4ee9-9cc3-9a1dfecfb383 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:26.768138 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-1bb59a48-cfd2-4ee9-9cc3-9a1dfecfb383 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 200 len: 1557 microversion: 2.1 time: 0.227960 Jun 27 15:54:26.769313 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 403/813] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:26 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 1557 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:26.795456 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a6c905d5-7037-488c-9561-93e516b1105d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:26.796328 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a6c905d5-7037-488c-9561-93e516b1105d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:26.803893 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a6c905d5-7037-488c-9561-93e516b1105d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:26.804222 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a6c905d5-7037-488c-9561-93e516b1105d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:26.805252 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a6c905d5-7037-488c-9561-93e516b1105d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:26.805921 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a6c905d5-7037-488c-9561-93e516b1105d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:26.915220 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a6c905d5-7037-488c-9561-93e516b1105d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125125 Jun 27 15:54:26.915812 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 411/814] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jun 27 15:54:26 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:54:27.144320 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-846452da-c997-4bc8-8f39-8d409a96f1ec tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:27.145716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-846452da-c997-4bc8-8f39-8d409a96f1ec tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:27.153767 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-846452da-c997-4bc8-8f39-8d409a96f1ec tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:27.154215 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-846452da-c997-4bc8-8f39-8d409a96f1ec tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:27.155225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-846452da-c997-4bc8-8f39-8d409a96f1ec tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:27.155671 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-846452da-c997-4bc8-8f39-8d409a96f1ec tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:27.194880 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-846452da-c997-4bc8-8f39-8d409a96f1ec tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055393 Jun 27 15:54:27.196028 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 404/815] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 27 15:54:27 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:54:27.212420 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-aabebb90-ac12-47ec-ba9b-670d7f071ad0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:27.213812 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-aabebb90-ac12-47ec-ba9b-670d7f071ad0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:27.224393 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-aabebb90-ac12-47ec-ba9b-670d7f071ad0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:27.225189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-aabebb90-ac12-47ec-ba9b-670d7f071ad0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:27.232142 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-aabebb90-ac12-47ec-ba9b-670d7f071ad0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:27.233062 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-aabebb90-ac12-47ec-ba9b-670d7f071ad0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:27.270412 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-aabebb90-ac12-47ec-ba9b-670d7f071ad0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments/90a9cbb4-36cf-40da-89e5-880c36ed15b5" status: 200 len: 194 microversion: 2.1 time: 0.065414 Jun 27 15:54:27.271373 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 412/816] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Jun 27 15:54:27 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments/90a9cbb4-36cf-40da-89e5-880c36ed15b5 => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:54:28.242991 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-a3c92b77-6348-486b-ac1d-c93cb6e746d5 req-0839739e-9ae1-4321-8dd7-2178ebccccbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f74d93df-6aac-45ba-83a0-4bafe2c375aa", "tag": "fef1e9fb-3e92-48c7-9b07-aaf3cd512ad4"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:54:28.257010 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-a3c92b77-6348-486b-ac1d-c93cb6e746d5 req-0839739e-9ae1-4321-8dd7-2178ebccccbb service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:28.257679 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-a3c92b77-6348-486b-ac1d-c93cb6e746d5 req-0839739e-9ae1-4321-8dd7-2178ebccccbb service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:28.273801 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-a3c92b77-6348-486b-ac1d-c93cb6e746d5 req-0839739e-9ae1-4321-8dd7-2178ebccccbb service nova] Creating event network-changed:fef1e9fb-3e92-48c7-9b07-aaf3cd512ad4 for instance f74d93df-6aac-45ba-83a0-4bafe2c375aa on hv-cinder-84780 Jun 27 15:54:28.280031 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-a3c92b77-6348-486b-ac1d-c93cb6e746d5 req-0839739e-9ae1-4321-8dd7-2178ebccccbb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041099 Jun 27 15:54:28.280640 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 405/817] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:54:28.714813 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d33ff7cb-b5b5-4b52-bfff-bc0199316a37 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcb16999-07a6-4c15-bf9c-d499a42e3f9b"}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:54:28.717814 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d33ff7cb-b5b5-4b52-bfff-bc0199316a37 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:28.730330 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d33ff7cb-b5b5-4b52-bfff-bc0199316a37 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:28.731454 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d33ff7cb-b5b5-4b52-bfff-bc0199316a37 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:28.733054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d33ff7cb-b5b5-4b52-bfff-bc0199316a37 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:28.734107 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d33ff7cb-b5b5-4b52-bfff-bc0199316a37 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:29.161888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d33ff7cb-b5b5-4b52-bfff-bc0199316a37 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "POST /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.454305 Jun 27 15:54:29.163546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 413/818] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 27 15:54:28 2022] POST /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments => generated 194 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:54:36.794228 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-992b6bf4-f205-4acc-8981-2aee65450443 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:36.795275 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-992b6bf4-f205-4acc-8981-2aee65450443 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:36.802252 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-992b6bf4-f205-4acc-8981-2aee65450443 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:36.802701 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-992b6bf4-f205-4acc-8981-2aee65450443 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:36.803490 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-992b6bf4-f205-4acc-8981-2aee65450443 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:36.803929 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-992b6bf4-f205-4acc-8981-2aee65450443 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:36.841255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-992b6bf4-f205-4acc-8981-2aee65450443 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052418 Jun 27 15:54:36.841905 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 406/819] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 27 15:54:36 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:54:36.952865 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a9e84fe2-c76b-4224-9283-7d68e9868007 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:36.953507 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a9e84fe2-c76b-4224-9283-7d68e9868007 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:36.960147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a9e84fe2-c76b-4224-9283-7d68e9868007 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:36.960595 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a9e84fe2-c76b-4224-9283-7d68e9868007 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:36.961380 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a9e84fe2-c76b-4224-9283-7d68e9868007 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:36.961851 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a9e84fe2-c76b-4224-9283-7d68e9868007 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:36.994406 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a9e84fe2-c76b-4224-9283-7d68e9868007 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments/90a9cbb4-36cf-40da-89e5-880c36ed15b5" status: 200 len: 194 microversion: 2.1 time: 0.047289 Jun 27 15:54:36.995023 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 414/820] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Jun 27 15:54:36 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments/90a9cbb4-36cf-40da-89e5-880c36ed15b5 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:54:37.012551 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f1e496a0-1b9b-4a1c-8430-26b914949bda tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:37.013446 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f1e496a0-1b9b-4a1c-8430-26b914949bda tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:37.024749 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f1e496a0-1b9b-4a1c-8430-26b914949bda tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:37.026104 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f1e496a0-1b9b-4a1c-8430-26b914949bda tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:37.027530 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f1e496a0-1b9b-4a1c-8430-26b914949bda tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:37.028337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f1e496a0-1b9b-4a1c-8430-26b914949bda tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:37.129934 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-f1e496a0-1b9b-4a1c-8430-26b914949bda tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lazy-loading 'services' on Instance uuid 9c290451-8495-4ac6-ba3c-28f2424d09f7 {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:54:37.213877 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f1e496a0-1b9b-4a1c-8430-26b914949bda tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments/90a9cbb4-36cf-40da-89e5-880c36ed15b5" status: 202 len: 0 microversion: 2.1 time: 0.207954 Jun 27 15:54:37.214432 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 407/821] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 27 15:54:37 2022] DELETE /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments/90a9cbb4-36cf-40da-89e5-880c36ed15b5 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:54:39.452545 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-219c7687-8f8b-4500-9796-27fdf6dd0f27 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:39.453431 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-219c7687-8f8b-4500-9796-27fdf6dd0f27 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:39.461205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-219c7687-8f8b-4500-9796-27fdf6dd0f27 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:39.461677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-219c7687-8f8b-4500-9796-27fdf6dd0f27 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:39.462464 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-219c7687-8f8b-4500-9796-27fdf6dd0f27 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:39.463491 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-219c7687-8f8b-4500-9796-27fdf6dd0f27 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:39.497972 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-219c7687-8f8b-4500-9796-27fdf6dd0f27 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments/dcb16999-07a6-4c15-bf9c-d499a42e3f9b" status: 200 len: 194 microversion: 2.1 time: 0.052037 Jun 27 15:54:39.498605 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 415/822] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Jun 27 15:54:39 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments/dcb16999-07a6-4c15-bf9c-d499a42e3f9b => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:54:39.510257 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-0b6f2168-e01e-4a29-a669-d2aef76761e4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:39.511601 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-0b6f2168-e01e-4a29-a669-d2aef76761e4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:39.519196 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0b6f2168-e01e-4a29-a669-d2aef76761e4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:39.519652 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0b6f2168-e01e-4a29-a669-d2aef76761e4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:39.520430 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0b6f2168-e01e-4a29-a669-d2aef76761e4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:39.520866 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0b6f2168-e01e-4a29-a669-d2aef76761e4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:39.625029 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-0b6f2168-e01e-4a29-a669-d2aef76761e4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lazy-loading 'services' on Instance uuid 9c290451-8495-4ac6-ba3c-28f2424d09f7 {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:54:39.712939 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-0b6f2168-e01e-4a29-a669-d2aef76761e4 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments/dcb16999-07a6-4c15-bf9c-d499a42e3f9b" status: 202 len: 0 microversion: 2.1 time: 0.207385 Jun 27 15:54:39.713715 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 408/823] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 27 15:54:39 2022] DELETE /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments/dcb16999-07a6-4c15-bf9c-d499a42e3f9b => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:54:40.921815 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-69086301-f6bd-4188-afd4-3776408a3b23 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:40.922819 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-69086301-f6bd-4188-afd4-3776408a3b23 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:40.929665 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-69086301-f6bd-4188-afd4-3776408a3b23 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:40.930128 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-69086301-f6bd-4188-afd4-3776408a3b23 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:40.930898 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-69086301-f6bd-4188-afd4-3776408a3b23 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:40.931466 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-69086301-f6bd-4188-afd4-3776408a3b23 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:40.965373 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-69086301-f6bd-4188-afd4-3776408a3b23 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048246 Jun 27 15:54:40.965980 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 416/824] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 27 15:54:40 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 15:54:41.080770 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c6aa6930-1895-43fa-8759-c25509cd9d34 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:41.082218 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c6aa6930-1895-43fa-8759-c25509cd9d34 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:41.090150 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c6aa6930-1895-43fa-8759-c25509cd9d34 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:41.090609 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c6aa6930-1895-43fa-8759-c25509cd9d34 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:41.091396 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c6aa6930-1895-43fa-8759-c25509cd9d34 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:41.091837 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c6aa6930-1895-43fa-8759-c25509cd9d34 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:41.127386 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c6aa6930-1895-43fa-8759-c25509cd9d34 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051060 Jun 27 15:54:41.127981 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 409/825] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 27 15:54:41 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 15:54:41.193472 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b22dd371-27d1-4a7a-a507-9ac959734aba tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:41.193993 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b22dd371-27d1-4a7a-a507-9ac959734aba tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:41.200716 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b22dd371-27d1-4a7a-a507-9ac959734aba tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:41.201797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b22dd371-27d1-4a7a-a507-9ac959734aba tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:41.201957 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b22dd371-27d1-4a7a-a507-9ac959734aba tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:41.202406 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b22dd371-27d1-4a7a-a507-9ac959734aba tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:41.232716 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b22dd371-27d1-4a7a-a507-9ac959734aba tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Going to try to terminate instance {{(pid=129473) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:54:41.321744 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b22dd371-27d1-4a7a-a507-9ac959734aba tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 204 len: 0 microversion: 2.1 time: 0.131293 Jun 27 15:54:41.322692 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 417/826] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:54:41 2022] DELETE /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:54:41.332431 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-0154cbb1-9dac-404b-a37a-790c7e9e1ca5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:41.333290 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-0154cbb1-9dac-404b-a37a-790c7e9e1ca5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:41.341457 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0154cbb1-9dac-404b-a37a-790c7e9e1ca5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:41.341967 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0154cbb1-9dac-404b-a37a-790c7e9e1ca5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:41.342823 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0154cbb1-9dac-404b-a37a-790c7e9e1ca5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:41.343251 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0154cbb1-9dac-404b-a37a-790c7e9e1ca5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:41.500245 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0154cbb1-9dac-404b-a37a-790c7e9e1ca5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:41.508338 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-0154cbb1-9dac-404b-a37a-790c7e9e1ca5 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 200 len: 1674 microversion: 2.1 time: 0.179906 Jun 27 15:54:41.508920 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 410/827] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:41 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:42.529448 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c9e33fe5-8a91-4814-9e76-8dd51f073363 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:42.530089 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c9e33fe5-8a91-4814-9e76-8dd51f073363 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:42.537286 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c9e33fe5-8a91-4814-9e76-8dd51f073363 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:42.537762 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c9e33fe5-8a91-4814-9e76-8dd51f073363 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:42.538549 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c9e33fe5-8a91-4814-9e76-8dd51f073363 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:42.538983 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c9e33fe5-8a91-4814-9e76-8dd51f073363 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:42.723326 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-c9e33fe5-8a91-4814-9e76-8dd51f073363 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:42.737434 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c9e33fe5-8a91-4814-9e76-8dd51f073363 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 200 len: 1674 microversion: 2.1 time: 0.213848 Jun 27 15:54:42.738529 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 418/828] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:42 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 1674 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:54:43.756858 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-57fca06f-1798-4d01-91a0-638127da6b34 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:43.757964 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-57fca06f-1798-4d01-91a0-638127da6b34 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:43.767316 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-57fca06f-1798-4d01-91a0-638127da6b34 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:43.767786 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-57fca06f-1798-4d01-91a0-638127da6b34 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:43.768953 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-57fca06f-1798-4d01-91a0-638127da6b34 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:43.770080 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-57fca06f-1798-4d01-91a0-638127da6b34 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:43.960979 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-57fca06f-1798-4d01-91a0-638127da6b34 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:43.975622 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-57fca06f-1798-4d01-91a0-638127da6b34 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 200 len: 1674 microversion: 2.1 time: 0.222511 Jun 27 15:54:43.976673 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 411/829] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:43 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 1674 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:44.772848 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-ee5d4cc0-6359-4504-9fc4-602e926730cc req-903fbe0d-b96a-4ffc-941e-a2de4cf6b8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c290451-8495-4ac6-ba3c-28f2424d09f7", "name": "network-vif-deleted", "tag": "870d2ba0-dc1e-46ce-bee6-0ce7f3252267"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:54:44.788298 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-ee5d4cc0-6359-4504-9fc4-602e926730cc req-903fbe0d-b96a-4ffc-941e-a2de4cf6b8c1 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:44.789507 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-ee5d4cc0-6359-4504-9fc4-602e926730cc req-903fbe0d-b96a-4ffc-941e-a2de4cf6b8c1 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:44.814812 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-ee5d4cc0-6359-4504-9fc4-602e926730cc req-903fbe0d-b96a-4ffc-941e-a2de4cf6b8c1 service nova] Creating event network-vif-deleted:870d2ba0-dc1e-46ce-bee6-0ce7f3252267 for instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 on hv-cinder-84780 Jun 27 15:54:44.824851 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-ee5d4cc0-6359-4504-9fc4-602e926730cc req-903fbe0d-b96a-4ffc-941e-a2de4cf6b8c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056123 Jun 27 15:54:44.826171 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 419/830] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:54:45.005412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-2db36576-fbb3-473a-b095-02ebd4fcc3a6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:45.008046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-2db36576-fbb3-473a-b095-02ebd4fcc3a6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:45.014034 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=36 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:54:45.026515 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2db36576-fbb3-473a-b095-02ebd4fcc3a6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:45.027255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2db36576-fbb3-473a-b095-02ebd4fcc3a6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:45.028647 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2db36576-fbb3-473a-b095-02ebd4fcc3a6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:45.033783 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2db36576-fbb3-473a-b095-02ebd4fcc3a6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:45.095943 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2db36576-fbb3-473a-b095-02ebd4fcc3a6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:45.096535 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2db36576-fbb3-473a-b095-02ebd4fcc3a6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:45.097091 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-2db36576-fbb3-473a-b095-02ebd4fcc3a6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lazy-loading 'fault' on Instance uuid 9c290451-8495-4ac6-ba3c-28f2424d09f7 {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:54:45.157481 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-2db36576-fbb3-473a-b095-02ebd4fcc3a6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35c652539f443d4895b5f81461833ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5846565bf74c5cac3ff5c3168cfd48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:45.172196 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-2db36576-fbb3-473a-b095-02ebd4fcc3a6 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 200 len: 1327 microversion: 2.1 time: 0.174783 Jun 27 15:54:45.173250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 412/831] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:44 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 1327 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:54:45.510075 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-681b77b1-3744-4428-b43b-44b5b58fe960 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:45.511215 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-681b77b1-3744-4428-b43b-44b5b58fe960 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:45.524713 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-681b77b1-3744-4428-b43b-44b5b58fe960 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:45.526426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-681b77b1-3744-4428-b43b-44b5b58fe960 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:45.528198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-681b77b1-3744-4428-b43b-44b5b58fe960 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:45.529001 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-681b77b1-3744-4428-b43b-44b5b58fe960 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:45.580953 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-681b77b1-3744-4428-b43b-44b5b58fe960 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd/ips" status: 200 len: 152 microversion: 2.20 time: 0.228843 Jun 27 15:54:45.589863 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 420/832] 10.222.0.20 () {60 vars in 1288 bytes} [Mon Jun 27 15:54:45 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd/ips => generated 152 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:54:46.194237 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-cf6fcb43-ef10-4572-bf13-f97edb177df0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:46.195552 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-cf6fcb43-ef10-4572-bf13-f97edb177df0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:46.204007 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cf6fcb43-ef10-4572-bf13-f97edb177df0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:46.204900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cf6fcb43-ef10-4572-bf13-f97edb177df0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:46.206314 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cf6fcb43-ef10-4572-bf13-f97edb177df0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:46.207072 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cf6fcb43-ef10-4572-bf13-f97edb177df0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:46.233447 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-cf6fcb43-ef10-4572-bf13-f97edb177df0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] HTTP exception thrown: Instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 could not be found. Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-cf6fcb43-ef10-4572-bf13-f97edb177df0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Request method failure captured: Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 HTTP/1.1 Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudE1mmjPV4F1e7Kt6odIfMxvvRt9542ZUCCkvsTh_Imzykgjec_bbDcPOQxUHGILE4kqRmk0s0dpGEl4HLn3i--mK4ymzwdVIR8G8mCEMr9z04FQKUTFwhf67Vol6UgMkP7dlfvKPEqaXFUOLxU8RweClUZvz90Rng2Ea2jSREfwnHc Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 5b5846565bf74c5cac3ff5c3168cfd48 Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-AttachVolumeTestJSON-138024671 Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:54:46.236759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:54:46.238496 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b5846565bf74c5cac3ff5c3168cfd48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b5846565bf74c5cac3ff5c3168cfd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b5846565bf74c5cac3ff5c3168cfd48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b5846565bf74c5cac3ff5c3168cfd48", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:54:46.238496 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-AttachVolumeTestJSON-138024671 Jun 27 15:54:46.238496 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 5b5846565bf74c5cac3ff5c3168cfd48 Jun 27 15:54:46.238496 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-AttachVolumeTestJSON-138024671 Jun 27 15:54:46.238496 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-AttachVolumeTestJSON-138024671-project Jun 27 15:54:46.238496 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:54:46.238496 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:54:46.238496 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: d35c652539f443d4895b5f81461833ba Jun 27 15:54:46.238496 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-AttachVolumeTestJSON-138024671-project Jun 27 15:54:46.238496 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:54:46.238496 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 could not be found. Jun 27 15:54:46.238496 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': '9c290451-8495-4ac6-ba3c-28f2424d09f7'} Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 could not be found. Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:54:46.239418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:54:46.240970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:54:46.240970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:54:46.240970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:54:46.240970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:54:46.240970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:54:46.240970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:54:46.240970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:54:46.240970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 could not be found. Jun 27 15:54:46.240970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:54:46.240970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:54:46.240970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:54:46.240970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:54:46.240970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:54:46.240970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:54:46.240970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:54:46.240970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:54:46.240970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 could not be found. Jun 27 15:54:46.240970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:54:46.242261 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-cf6fcb43-ef10-4572-bf13-f97edb177df0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Returning 404 to user: Instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:54:46.242261 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-cf6fcb43-ef10-4572-bf13-f97edb177df0 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 404 len: 111 microversion: 2.1 time: 0.050393 Jun 27 15:54:46.242261 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 413/833] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:46 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:54:46.252339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3cbe245e-b8fc-45fd-a2bf-2126095b804c tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '.version_select at 0x7fe14ac76160>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:46.272685 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3cbe245e-b8fc-45fd-a2bf-2126095b804c tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-736514183" status: 202 len: 0 microversion: 2.1 time: 0.024123 Jun 27 15:54:46.273405 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 421/834] 10.222.0.20 () {58 vars in 1217 bytes} [Mon Jun 27 15:54:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-736514183 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:54:47.905612 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-b019f16a-2b29-4c34-a763-f8d8edeaa1f1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:54:47.906306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-b019f16a-2b29-4c34-a763-f8d8edeaa1f1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:47.913673 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b019f16a-2b29-4c34-a763-f8d8edeaa1f1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:47.914125 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b019f16a-2b29-4c34-a763-f8d8edeaa1f1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:47.914918 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b019f16a-2b29-4c34-a763-f8d8edeaa1f1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:47.915355 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b019f16a-2b29-4c34-a763-f8d8edeaa1f1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:47.945723 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-b019f16a-2b29-4c34-a763-f8d8edeaa1f1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lazy-loading 'flavor' on Instance uuid 32a5fc50-738a-4228-9733-e9e7b34daccd {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:54:48.253528 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-b019f16a-2b29-4c34-a763-f8d8edeaa1f1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "POST /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd/action" status: 202 len: 0 microversion: 2.20 time: 0.351850 Jun 27 15:54:48.254803 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 414/835] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jun 27 15:54:47 2022] POST /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:54:48.269815 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-2aba7dd7-66a1-4975-b138-9028ac240853 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:48.270815 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-2aba7dd7-66a1-4975-b138-9028ac240853 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:48.283320 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2aba7dd7-66a1-4975-b138-9028ac240853 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:48.284092 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2aba7dd7-66a1-4975-b138-9028ac240853 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:48.285558 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2aba7dd7-66a1-4975-b138-9028ac240853 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:48.286334 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2aba7dd7-66a1-4975-b138-9028ac240853 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:48.311970 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:54:48.455776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2aba7dd7-66a1-4975-b138-9028ac240853 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:48.465281 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2aba7dd7-66a1-4975-b138-9028ac240853 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:48.466845 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2aba7dd7-66a1-4975-b138-9028ac240853 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:48.468054 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-2aba7dd7-66a1-4975-b138-9028ac240853 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.205200 Jun 27 15:54:48.468620 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 422/836] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:54:48 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:54:49.382266 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-37c4335a-6aa0-4c0d-960b-ed1b8252250d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:49.383120 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-37c4335a-6aa0-4c0d-960b-ed1b8252250d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:49.391079 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-37c4335a-6aa0-4c0d-960b-ed1b8252250d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:49.391550 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-37c4335a-6aa0-4c0d-960b-ed1b8252250d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:49.392416 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-37c4335a-6aa0-4c0d-960b-ed1b8252250d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:49.393015 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-37c4335a-6aa0-4c0d-960b-ed1b8252250d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:49.408840 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-37c4335a-6aa0-4c0d-960b-ed1b8252250d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] HTTP exception thrown: Instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 could not be found. Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-37c4335a-6aa0-4c0d-960b-ed1b8252250d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Request method failure captured: Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: DELETE /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 HTTP/1.1 Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudE1mmjPV4F1e7Kt6odIfMxvvRt9542ZUCCkvsTh_Imzykgjec_bbDcPOQxUHGILE4kqRmk0s0dpGEl4HLn3i--mK4ymzwdVIR8G8mCEMr9z04FQKUTFwhf67Vol6UgMkP7dlfvKPEqaXFUOLxU8RweClUZvz90Rng2Ea2jSREfwnHc Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 5b5846565bf74c5cac3ff5c3168cfd48 Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-AttachVolumeTestJSON-138024671 Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:54:49.410585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:54:49.412719 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b5846565bf74c5cac3ff5c3168cfd48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b5846565bf74c5cac3ff5c3168cfd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b5846565bf74c5cac3ff5c3168cfd48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b5846565bf74c5cac3ff5c3168cfd48", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:54:49.412719 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-AttachVolumeTestJSON-138024671 Jun 27 15:54:49.412719 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 5b5846565bf74c5cac3ff5c3168cfd48 Jun 27 15:54:49.412719 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-AttachVolumeTestJSON-138024671 Jun 27 15:54:49.412719 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-AttachVolumeTestJSON-138024671-project Jun 27 15:54:49.412719 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:54:49.412719 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:54:49.412719 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: d35c652539f443d4895b5f81461833ba Jun 27 15:54:49.412719 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-AttachVolumeTestJSON-138024671-project Jun 27 15:54:49.412719 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:54:49.412719 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 could not be found. Jun 27 15:54:49.412719 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': '9c290451-8495-4ac6-ba3c-28f2424d09f7'} Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 could not be found. Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:54:49.414148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 could not be found. Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 could not be found. Jun 27 15:54:49.416619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:54:49.418557 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-37c4335a-6aa0-4c0d-960b-ed1b8252250d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Returning 404 to user: Instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:54:49.418557 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-37c4335a-6aa0-4c0d-960b-ed1b8252250d tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 404 len: 111 microversion: 2.1 time: 0.034689 Jun 27 15:54:49.418557 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 415/837] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:54:49 2022] DELETE /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:54:49.424207 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0f89f020-96bc-426d-aeb0-ba83c32594f9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:49.425307 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-0f89f020-96bc-426d-aeb0-ba83c32594f9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 9c290451-8495-4ac6-ba3c-28f2424d09f7] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:49.436756 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0f89f020-96bc-426d-aeb0-ba83c32594f9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:49.437884 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0f89f020-96bc-426d-aeb0-ba83c32594f9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:49.440114 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0f89f020-96bc-426d-aeb0-ba83c32594f9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:49.440900 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0f89f020-96bc-426d-aeb0-ba83c32594f9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:49.471500 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-0f89f020-96bc-426d-aeb0-ba83c32594f9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] HTTP exception thrown: Instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 could not be found. Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0f89f020-96bc-426d-aeb0-ba83c32594f9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Request method failure captured: Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 HTTP/1.1 Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudE1mmjPV4F1e7Kt6odIfMxvvRt9542ZUCCkvsTh_Imzykgjec_bbDcPOQxUHGILE4kqRmk0s0dpGEl4HLn3i--mK4ymzwdVIR8G8mCEMr9z04FQKUTFwhf67Vol6UgMkP7dlfvKPEqaXFUOLxU8RweClUZvz90Rng2Ea2jSREfwnHc Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 5b5846565bf74c5cac3ff5c3168cfd48 Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-AttachVolumeTestJSON-138024671 Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:54:49.473339 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:54:49.475616 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b5846565bf74c5cac3ff5c3168cfd48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b5846565bf74c5cac3ff5c3168cfd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b5846565bf74c5cac3ff5c3168cfd48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b5846565bf74c5cac3ff5c3168cfd48", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:54:49.475616 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-AttachVolumeTestJSON-138024671 Jun 27 15:54:49.475616 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 5b5846565bf74c5cac3ff5c3168cfd48 Jun 27 15:54:49.475616 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-AttachVolumeTestJSON-138024671 Jun 27 15:54:49.475616 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-AttachVolumeTestJSON-138024671-project Jun 27 15:54:49.475616 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:54:49.475616 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:54:49.475616 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: d35c652539f443d4895b5f81461833ba Jun 27 15:54:49.475616 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-AttachVolumeTestJSON-138024671-project Jun 27 15:54:49.475616 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:54:49.475616 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 could not be found. Jun 27 15:54:49.475616 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': '9c290451-8495-4ac6-ba3c-28f2424d09f7'} Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 could not be found. Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:54:49.476986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:54:49.479146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:54:49.479146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:54:49.479146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:54:49.479146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:54:49.479146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:54:49.479146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:54:49.479146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:54:49.479146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 could not be found. Jun 27 15:54:49.479146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:54:49.479146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:54:49.479146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:54:49.479146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:54:49.479146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:54:49.479146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:54:49.479146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:54:49.479146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:54:49.479146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 could not be found. Jun 27 15:54:49.479146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:54:49.481097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0f89f020-96bc-426d-aeb0-ba83c32594f9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Returning 404 to user: Instance 9c290451-8495-4ac6-ba3c-28f2424d09f7 could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:54:49.481097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-0f89f020-96bc-426d-aeb0-ba83c32594f9 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7" status: 404 len: 111 microversion: 2.1 time: 0.057688 Jun 27 15:54:49.481097 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 423/838] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:49 2022] GET /compute/v2.1/servers/9c290451-8495-4ac6-ba3c-28f2424d09f7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:54:49.488721 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-81f8609c-828a-4afc-aa63-f8b13c22f7a7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:49.489609 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-81f8609c-828a-4afc-aa63-f8b13c22f7a7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:49.498345 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81f8609c-828a-4afc-aa63-f8b13c22f7a7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:49.498948 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81f8609c-828a-4afc-aa63-f8b13c22f7a7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:49.499835 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81f8609c-828a-4afc-aa63-f8b13c22f7a7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:49.500369 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81f8609c-828a-4afc-aa63-f8b13c22f7a7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:49.525230 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:54:49.696415 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-81f8609c-828a-4afc-aa63-f8b13c22f7a7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:49.705514 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-81f8609c-828a-4afc-aa63-f8b13c22f7a7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:49.707088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-81f8609c-828a-4afc-aa63-f8b13c22f7a7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:49.708309 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-81f8609c-828a-4afc-aa63-f8b13c22f7a7 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.224750 Jun 27 15:54:49.708894 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 416/839] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:54:49 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:54:50.648723 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-95cbd2bc-7acb-43b1-a522-e80a1ecb3470 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:50.649407 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-95cbd2bc-7acb-43b1-a522-e80a1ecb3470 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:50.658153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-95cbd2bc-7acb-43b1-a522-e80a1ecb3470 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:50.658603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-95cbd2bc-7acb-43b1-a522-e80a1ecb3470 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:50.659386 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-95cbd2bc-7acb-43b1-a522-e80a1ecb3470 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:50.659822 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-95cbd2bc-7acb-43b1-a522-e80a1ecb3470 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:50.676547 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-95cbd2bc-7acb-43b1-a522-e80a1ecb3470 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] HTTP exception thrown: Instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb could not be found. Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-95cbd2bc-7acb-43b1-a522-e80a1ecb3470 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Request method failure captured: Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: DELETE /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb HTTP/1.1 Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudE1mmjPV4F1e7Kt6odIfMxvvRt9542ZUCCkvsTh_Imzykgjec_bbDcPOQxUHGILE4kqRmk0s0dpGEl4HLn3i--mK4ymzwdVIR8G8mCEMr9z04FQKUTFwhf67Vol6UgMkP7dlfvKPEqaXFUOLxU8RweClUZvz90Rng2Ea2jSREfwnHc Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 5b5846565bf74c5cac3ff5c3168cfd48 Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-AttachVolumeTestJSON-138024671 Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:54:50.678157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:54:50.679826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b5846565bf74c5cac3ff5c3168cfd48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b5846565bf74c5cac3ff5c3168cfd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b5846565bf74c5cac3ff5c3168cfd48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b5846565bf74c5cac3ff5c3168cfd48", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:54:50.679826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-AttachVolumeTestJSON-138024671 Jun 27 15:54:50.679826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 5b5846565bf74c5cac3ff5c3168cfd48 Jun 27 15:54:50.679826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-AttachVolumeTestJSON-138024671 Jun 27 15:54:50.679826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-AttachVolumeTestJSON-138024671-project Jun 27 15:54:50.679826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:54:50.679826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:54:50.679826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: d35c652539f443d4895b5f81461833ba Jun 27 15:54:50.679826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-AttachVolumeTestJSON-138024671-project Jun 27 15:54:50.679826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:54:50.679826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb could not be found. Jun 27 15:54:50.679826 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': '0a1e27a3-c6e6-42ec-9a80-fa6806324aeb'} Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb could not be found. Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:54:50.680677 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb could not be found. Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb could not be found. Jun 27 15:54:50.682353 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:54:50.684085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-95cbd2bc-7acb-43b1-a522-e80a1ecb3470 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Returning 404 to user: Instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:54:50.684085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-95cbd2bc-7acb-43b1-a522-e80a1ecb3470 tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 404 len: 111 microversion: 2.1 time: 0.034871 Jun 27 15:54:50.684085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 424/840] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:54:50 2022] DELETE /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:54:50.692925 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-661c1164-e5d4-4995-a523-9e8721032e8a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:50.694082 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-661c1164-e5d4-4995-a523-9e8721032e8a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] [instance: 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:50.706565 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-661c1164-e5d4-4995-a523-9e8721032e8a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:50.707364 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-661c1164-e5d4-4995-a523-9e8721032e8a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:50.708764 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-661c1164-e5d4-4995-a523-9e8721032e8a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:50.709515 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-661c1164-e5d4-4995-a523-9e8721032e8a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:50.727624 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-7a1962d6-11ca-4a5f-a5c0-788667bce104 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:50.728864 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-7a1962d6-11ca-4a5f-a5c0-788667bce104 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:50.735393 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7a1962d6-11ca-4a5f-a5c0-788667bce104 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:50.735843 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7a1962d6-11ca-4a5f-a5c0-788667bce104 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:50.736605 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-661c1164-e5d4-4995-a523-9e8721032e8a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] HTTP exception thrown: Instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb could not be found. Jun 27 15:54:50.736755 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7a1962d6-11ca-4a5f-a5c0-788667bce104 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:50.737045 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7a1962d6-11ca-4a5f-a5c0-788667bce104 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-661c1164-e5d4-4995-a523-9e8721032e8a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Request method failure captured: Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb HTTP/1.1 Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudE1mmjPV4F1e7Kt6odIfMxvvRt9542ZUCCkvsTh_Imzykgjec_bbDcPOQxUHGILE4kqRmk0s0dpGEl4HLn3i--mK4ymzwdVIR8G8mCEMr9z04FQKUTFwhf67Vol6UgMkP7dlfvKPEqaXFUOLxU8RweClUZvz90Rng2Ea2jSREfwnHc Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 5b5846565bf74c5cac3ff5c3168cfd48 Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-AttachVolumeTestJSON-138024671 Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:54:50.739751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:54:50.744016 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b5846565bf74c5cac3ff5c3168cfd48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b5846565bf74c5cac3ff5c3168cfd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b5846565bf74c5cac3ff5c3168cfd48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b5846565bf74c5cac3ff5c3168cfd48", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:54:50.744016 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-AttachVolumeTestJSON-138024671 Jun 27 15:54:50.744016 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 5b5846565bf74c5cac3ff5c3168cfd48 Jun 27 15:54:50.744016 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-AttachVolumeTestJSON-138024671 Jun 27 15:54:50.744016 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-AttachVolumeTestJSON-138024671-project Jun 27 15:54:50.744016 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:54:50.744016 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:54:50.744016 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: d35c652539f443d4895b5f81461833ba Jun 27 15:54:50.744016 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-AttachVolumeTestJSON-138024671-project Jun 27 15:54:50.744016 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:54:50.744016 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb could not be found. Jun 27 15:54:50.744016 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': '0a1e27a3-c6e6-42ec-9a80-fa6806324aeb'} Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb could not be found. Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:54:50.745688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:54:50.748820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:54:50.748820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:54:50.748820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:54:50.748820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:54:50.748820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:54:50.748820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:54:50.748820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:54:50.748820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb could not be found. Jun 27 15:54:50.748820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:54:50.748820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:54:50.748820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:54:50.748820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:54:50.748820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:54:50.748820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:54:50.748820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:54:50.748820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:54:50.748820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb could not be found. Jun 27 15:54:50.748820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:54:50.752327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-661c1164-e5d4-4995-a523-9e8721032e8a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] Returning 404 to user: Instance 0a1e27a3-c6e6-42ec-9a80-fa6806324aeb could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:54:50.752327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-661c1164-e5d4-4995-a523-9e8721032e8a tempest-AttachVolumeTestJSON-138024671 tempest-AttachVolumeTestJSON-138024671-project] 10.222.0.20 "GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb" status: 404 len: 111 microversion: 2.1 time: 0.056434 Jun 27 15:54:50.752327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 417/841] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:54:50 2022] GET /compute/v2.1/servers/0a1e27a3-c6e6-42ec-9a80-fa6806324aeb => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:54:50.927061 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-7a1962d6-11ca-4a5f-a5c0-788667bce104 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:50.937481 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-7a1962d6-11ca-4a5f-a5c0-788667bce104 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:50.939021 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-7a1962d6-11ca-4a5f-a5c0-788667bce104 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:50.940206 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-7a1962d6-11ca-4a5f-a5c0-788667bce104 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.216588 Jun 27 15:54:50.941141 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 425/842] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:54:50 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:54:51.960551 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-6c461cc9-def0-4fe8-b03d-8876aa0000ad tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:51.961447 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-6c461cc9-def0-4fe8-b03d-8876aa0000ad tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:51.969401 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6c461cc9-def0-4fe8-b03d-8876aa0000ad tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:51.969901 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6c461cc9-def0-4fe8-b03d-8876aa0000ad tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:51.970700 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6c461cc9-def0-4fe8-b03d-8876aa0000ad tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:51.971147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6c461cc9-def0-4fe8-b03d-8876aa0000ad tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:52.168791 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-6c461cc9-def0-4fe8-b03d-8876aa0000ad tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:52.187644 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-6c461cc9-def0-4fe8-b03d-8876aa0000ad tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:52.191334 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-6c461cc9-def0-4fe8-b03d-8876aa0000ad tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:52.194110 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-6c461cc9-def0-4fe8-b03d-8876aa0000ad tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.237319 Jun 27 15:54:52.198691 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 418/843] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:54:51 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:54:53.215203 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-fb962d32-886e-4511-8c79-a0a087b607cf tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:53.216031 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-fb962d32-886e-4511-8c79-a0a087b607cf tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:53.223390 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fb962d32-886e-4511-8c79-a0a087b607cf tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:53.224140 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fb962d32-886e-4511-8c79-a0a087b607cf tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:53.225051 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fb962d32-886e-4511-8c79-a0a087b607cf tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:53.225705 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fb962d32-886e-4511-8c79-a0a087b607cf tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:53.750690 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-fb962d32-886e-4511-8c79-a0a087b607cf tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:53.759646 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-fb962d32-886e-4511-8c79-a0a087b607cf tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:53.761295 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-fb962d32-886e-4511-8c79-a0a087b607cf tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:53.762582 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-fb962d32-886e-4511-8c79-a0a087b607cf tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.553228 Jun 27 15:54:53.763245 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 426/844] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:54:53 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:54:54.784940 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c400744a-ad27-400c-bf48-7f0b0a56c238 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:54.785831 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c400744a-ad27-400c-bf48-7f0b0a56c238 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:54.806650 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c400744a-ad27-400c-bf48-7f0b0a56c238 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:54.807110 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c400744a-ad27-400c-bf48-7f0b0a56c238 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:54.808198 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c400744a-ad27-400c-bf48-7f0b0a56c238 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:54.810279 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c400744a-ad27-400c-bf48-7f0b0a56c238 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:55.139364 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-c400744a-ad27-400c-bf48-7f0b0a56c238 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:55.150929 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-c400744a-ad27-400c-bf48-7f0b0a56c238 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:55.154025 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-c400744a-ad27-400c-bf48-7f0b0a56c238 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:55.156470 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c400744a-ad27-400c-bf48-7f0b0a56c238 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.376630 Jun 27 15:54:55.157547 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 419/845] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:54:54 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:54:56.177305 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-2d945af2-1e3c-454a-9d41-9887cd6d609a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:56.178212 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-2d945af2-1e3c-454a-9d41-9887cd6d609a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:56.180848 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:54:56.190979 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2d945af2-1e3c-454a-9d41-9887cd6d609a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:56.191760 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2d945af2-1e3c-454a-9d41-9887cd6d609a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:56.193234 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2d945af2-1e3c-454a-9d41-9887cd6d609a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:56.194071 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2d945af2-1e3c-454a-9d41-9887cd6d609a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:56.391911 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2d945af2-1e3c-454a-9d41-9887cd6d609a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:56.401062 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2d945af2-1e3c-454a-9d41-9887cd6d609a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:56.402655 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2d945af2-1e3c-454a-9d41-9887cd6d609a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:56.403851 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-2d945af2-1e3c-454a-9d41-9887cd6d609a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.230540 Jun 27 15:54:56.404410 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 427/846] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:54:56 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:54:56.656205 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-4ec686b0-e2af-4e37-a9d3-5316a042b671 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1882686125"}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:54:56.657028 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-4ec686b0-e2af-4e37-a9d3-5316a042b671 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:56.666582 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4ec686b0-e2af-4e37-a9d3-5316a042b671 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:56.667368 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4ec686b0-e2af-4e37-a9d3-5316a042b671 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:56.669104 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4ec686b0-e2af-4e37-a9d3-5316a042b671 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:56.669906 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4ec686b0-e2af-4e37-a9d3-5316a042b671 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:56.866121 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.network.security_group_api [None req-4ec686b0-e2af-4e37-a9d3-5316a042b671 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Removing security group c0758086-aa6a-415a-ba3e-2cfab41a8498 from port f3f58277-1227-4989-91cb-3c2473267d77 Jun 27 15:54:57.323112 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-4ec686b0-e2af-4e37-a9d3-5316a042b671 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "POST /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34/action" status: 202 len: 0 microversion: 2.1 time: 0.674173 Jun 27 15:54:57.324478 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 420/847] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 27 15:54:56 2022] POST /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34/action => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:54:57.332999 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-64b30c37-9ecc-4a75-b0fa-fe3d2c386564 req-3d285234-8367-47cc-a59e-af50f1f4c414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d5e0c6-2148-42b6-80f2-8c86f7d62e34", "tag": "f3f58277-1227-4989-91cb-3c2473267d77"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:54:57.372212 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-64b30c37-9ecc-4a75-b0fa-fe3d2c386564 req-3d285234-8367-47cc-a59e-af50f1f4c414 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:57.372669 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-64b30c37-9ecc-4a75-b0fa-fe3d2c386564 req-3d285234-8367-47cc-a59e-af50f1f4c414 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:57.408333 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-64b30c37-9ecc-4a75-b0fa-fe3d2c386564 req-3d285234-8367-47cc-a59e-af50f1f4c414 service nova] Creating event network-changed:f3f58277-1227-4989-91cb-3c2473267d77 for instance 04d5e0c6-2148-42b6-80f2-8c86f7d62e34 on hv-cinder-84780 Jun 27 15:54:57.414659 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-64b30c37-9ecc-4a75-b0fa-fe3d2c386564 req-3d285234-8367-47cc-a59e-af50f1f4c414 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085106 Jun 27 15:54:57.419394 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 428/848] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:54:57.432124 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-354de3e5-1a65-4bf4-8097-80eb0ecf6e26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:57.435545 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-354de3e5-1a65-4bf4-8097-80eb0ecf6e26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:57.454287 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-354de3e5-1a65-4bf4-8097-80eb0ecf6e26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:57.455121 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-354de3e5-1a65-4bf4-8097-80eb0ecf6e26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:57.456738 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-354de3e5-1a65-4bf4-8097-80eb0ecf6e26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:57.457563 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-354de3e5-1a65-4bf4-8097-80eb0ecf6e26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:57.768364 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-354de3e5-1a65-4bf4-8097-80eb0ecf6e26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:57.795722 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-354de3e5-1a65-4bf4-8097-80eb0ecf6e26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:57.812029 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-354de3e5-1a65-4bf4-8097-80eb0ecf6e26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:57.813798 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-354de3e5-1a65-4bf4-8097-80eb0ecf6e26 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.393511 Jun 27 15:54:57.815120 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 421/849] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:54:57 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:54:58.845121 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3e655cca-adfa-41c2-a9b7-2be7740bd2ba tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:58.846405 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3e655cca-adfa-41c2-a9b7-2be7740bd2ba tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:58.860784 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3e655cca-adfa-41c2-a9b7-2be7740bd2ba tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:58.861558 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3e655cca-adfa-41c2-a9b7-2be7740bd2ba tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:58.863367 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3e655cca-adfa-41c2-a9b7-2be7740bd2ba tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:58.864123 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3e655cca-adfa-41c2-a9b7-2be7740bd2ba tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:59.064857 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3e655cca-adfa-41c2-a9b7-2be7740bd2ba tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:59.075864 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3e655cca-adfa-41c2-a9b7-2be7740bd2ba tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:59.077368 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3e655cca-adfa-41c2-a9b7-2be7740bd2ba tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:54:59.078665 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3e655cca-adfa-41c2-a9b7-2be7740bd2ba tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.243485 Jun 27 15:54:59.079248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 429/850] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:54:58 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:54:59.629215 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-db9d1542-6fe1-4bca-90f0-c553e40603e3 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:54:59.630139 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-b64042b7-1355-4585-9fa9-407dd81ef8a9 req-891971b6-fcf8-42d0-a805-8fc9d28fdfd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d5e0c6-2148-42b6-80f2-8c86f7d62e34", "tag": "f3f58277-1227-4989-91cb-3c2473267d77"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:54:59.631378 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-db9d1542-6fe1-4bca-90f0-c553e40603e3 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:54:59.640352 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-b64042b7-1355-4585-9fa9-407dd81ef8a9 req-891971b6-fcf8-42d0-a805-8fc9d28fdfd0 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:59.641702 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-b64042b7-1355-4585-9fa9-407dd81ef8a9 req-891971b6-fcf8-42d0-a805-8fc9d28fdfd0 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:59.645954 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-db9d1542-6fe1-4bca-90f0-c553e40603e3 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:59.647451 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-db9d1542-6fe1-4bca-90f0-c553e40603e3 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:59.649174 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-db9d1542-6fe1-4bca-90f0-c553e40603e3 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:54:59.650842 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-db9d1542-6fe1-4bca-90f0-c553e40603e3 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:54:59.659803 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-b64042b7-1355-4585-9fa9-407dd81ef8a9 req-891971b6-fcf8-42d0-a805-8fc9d28fdfd0 service nova] Creating event network-changed:f3f58277-1227-4989-91cb-3c2473267d77 for instance 04d5e0c6-2148-42b6-80f2-8c86f7d62e34 on hv-cinder-84780 Jun 27 15:54:59.668180 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-b64042b7-1355-4585-9fa9-407dd81ef8a9 req-891971b6-fcf8-42d0-a805-8fc9d28fdfd0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042694 Jun 27 15:54:59.669477 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 430/851] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:54:59.832939 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-db9d1542-6fe1-4bca-90f0-c553e40603e3 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lazy-loading 'services' on Instance uuid 04d5e0c6-2148-42b6-80f2-8c86f7d62e34 {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:55:00.024338 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-db9d1542-6fe1-4bca-90f0-c553e40603e3 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "DELETE /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34/os-volume_attachments/cda986b2-b1cd-407a-a23a-cf82b1f10bf6" status: 202 len: 0 microversion: 2.1 time: 0.402878 Jun 27 15:55:00.030773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 422/852] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 27 15:54:59 2022] DELETE /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34/os-volume_attachments/cda986b2-b1cd-407a-a23a-cf82b1f10bf6 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:55:00.041044 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d08c2b14-b1d2-468c-b3e1-a5423d2857a4 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:00.042477 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d08c2b14-b1d2-468c-b3e1-a5423d2857a4 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:00.050005 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d08c2b14-b1d2-468c-b3e1-a5423d2857a4 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:00.050801 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d08c2b14-b1d2-468c-b3e1-a5423d2857a4 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:00.051765 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d08c2b14-b1d2-468c-b3e1-a5423d2857a4 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:00.052313 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d08c2b14-b1d2-468c-b3e1-a5423d2857a4 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:00.091003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d08c2b14-b1d2-468c-b3e1-a5423d2857a4 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059153 Jun 27 15:55:00.096544 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 431/853] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 27 15:55:00 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:55:00.119206 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-facbb54d-07e1-468c-9781-126b3e2e2f79 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:00.120360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-facbb54d-07e1-468c-9781-126b3e2e2f79 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:00.131715 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-facbb54d-07e1-468c-9781-126b3e2e2f79 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:00.133141 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-facbb54d-07e1-468c-9781-126b3e2e2f79 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:00.136638 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-facbb54d-07e1-468c-9781-126b3e2e2f79 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:00.139012 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-facbb54d-07e1-468c-9781-126b3e2e2f79 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:00.388105 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-facbb54d-07e1-468c-9781-126b3e2e2f79 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:00.405140 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-facbb54d-07e1-468c-9781-126b3e2e2f79 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:00.408389 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-facbb54d-07e1-468c-9781-126b3e2e2f79 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:00.410621 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-facbb54d-07e1-468c-9781-126b3e2e2f79 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.300705 Jun 27 15:55:00.411457 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 423/854] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:00 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:01.109731 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-7ce8eadc-5cd4-432d-8cda-8d67d4c33aac tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:01.112745 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-7ce8eadc-5cd4-432d-8cda-8d67d4c33aac tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:01.125282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7ce8eadc-5cd4-432d-8cda-8d67d4c33aac tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:01.126886 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7ce8eadc-5cd4-432d-8cda-8d67d4c33aac tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:01.128159 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7ce8eadc-5cd4-432d-8cda-8d67d4c33aac tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:01.129271 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7ce8eadc-5cd4-432d-8cda-8d67d4c33aac tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:01.174296 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-7ce8eadc-5cd4-432d-8cda-8d67d4c33aac tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073265 Jun 27 15:55:01.174989 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 432/855] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 27 15:55:01 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:55:01.435770 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a7e2c2a2-d7d1-4c89-b52a-6005bbf506d8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:01.436762 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a7e2c2a2-d7d1-4c89-b52a-6005bbf506d8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:01.445055 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a7e2c2a2-d7d1-4c89-b52a-6005bbf506d8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:01.445579 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a7e2c2a2-d7d1-4c89-b52a-6005bbf506d8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:01.446725 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a7e2c2a2-d7d1-4c89-b52a-6005bbf506d8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:01.447353 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a7e2c2a2-d7d1-4c89-b52a-6005bbf506d8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:01.631328 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a7e2c2a2-d7d1-4c89-b52a-6005bbf506d8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:01.641982 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a7e2c2a2-d7d1-4c89-b52a-6005bbf506d8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:01.644255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a7e2c2a2-d7d1-4c89-b52a-6005bbf506d8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:01.645804 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-a7e2c2a2-d7d1-4c89-b52a-6005bbf506d8 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.215727 Jun 27 15:55:01.646434 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 424/856] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:01 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:55:02.189967 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a3803737-ceb8-4898-a61c-1c192211530e tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:02.190916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a3803737-ceb8-4898-a61c-1c192211530e tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:02.199368 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a3803737-ceb8-4898-a61c-1c192211530e tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:02.199817 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a3803737-ceb8-4898-a61c-1c192211530e tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:02.200611 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a3803737-ceb8-4898-a61c-1c192211530e tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:02.201044 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a3803737-ceb8-4898-a61c-1c192211530e tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:02.246489 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a3803737-ceb8-4898-a61c-1c192211530e tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060441 Jun 27 15:55:02.247610 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 433/857] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 27 15:55:02 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 15:55:02.262209 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-530f3961-b7e4-48c2-bcf5-9a0b57c533ad tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:02.262816 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-530f3961-b7e4-48c2-bcf5-9a0b57c533ad tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:02.274105 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-530f3961-b7e4-48c2-bcf5-9a0b57c533ad tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:02.274976 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-530f3961-b7e4-48c2-bcf5-9a0b57c533ad tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:02.276457 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-530f3961-b7e4-48c2-bcf5-9a0b57c533ad tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:02.277476 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-530f3961-b7e4-48c2-bcf5-9a0b57c533ad tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:02.369055 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-530f3961-b7e4-48c2-bcf5-9a0b57c533ad tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] HTTP exception thrown: Instance 04d5e0c6-2148-42b6-80f2-8c86f7d62e34 is not attached to volume cda986b2-b1cd-407a-a23a-cf82b1f10bf6 Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-530f3961-b7e4-48c2-bcf5-9a0b57c533ad tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Request method failure captured: Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: DELETE /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34/os-volume_attachments/cda986b2-b1cd-407a-a23a-cf82b1f10bf6 HTTP/1.1 Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudJCd5lJBbrQKEJnL2Uj-y6VTbh7BwQ2F2o-o7AbsZWyegTt3WJCrct2v1b2u5Dv_GMnKlqqfK_MWb2TJZM3F2z19wT_aI-vnpV5gpSx2YiDSukMgwfpfiek1sLgmssNMoszL6gsrP5F-3ZYs44urNyKSry5UhBku7DC_sXOxIEvAdQ Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 6a070d552fee4594bbcf0ae7adc16f94 Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-TestMinimumBasicScenario-187184001 Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:55:02.372088 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:55:02.374548 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a070d552fee4594bbcf0ae7adc16f94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a070d552fee4594bbcf0ae7adc16f94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a070d552fee4594bbcf0ae7adc16f94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a070d552fee4594bbcf0ae7adc16f94", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:55:02.374548 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-TestMinimumBasicScenario-187184001 Jun 27 15:55:02.374548 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 6a070d552fee4594bbcf0ae7adc16f94 Jun 27 15:55:02.374548 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-TestMinimumBasicScenario-187184001 Jun 27 15:55:02.374548 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-TestMinimumBasicScenario-187184001-project Jun 27 15:55:02.374548 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:55:02.374548 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:55:02.374548 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: 1320328d4bd04dc28c0c828a0f30e641 Jun 27 15:55:02.374548 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-TestMinimumBasicScenario-187184001-project Jun 27 15:55:02.374548 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:55:02.374548 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance 04d5e0c6-2148-42b6-80f2-8c86f7d62e34 is not attached to volume cda986b2-b1cd-407a-a23a-cf82b1f10bf6 Jun 27 15:55:02.376038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'server_id': '04d5e0c6-2148-42b6-80f2-8c86f7d62e34', 'id': 'cda986b2-b1cd-407a-a23a-cf82b1f10bf6'} Jun 27 15:55:02.376038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:55:02.376038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:55:02.376038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 27 15:55:02.376038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 27 15:55:02.376038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 15:55:02.376038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 15:55:02.376038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 27 15:55:02.376038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 27 15:55:02.376038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cda986b2-b1cd-407a-a23a-cf82b1f10bf6. Jun 27 15:55:02.376038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:55:02.376038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:55:02.376038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:55:02.376038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:55:02.376038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:55:02.376038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:55:02.376038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:55:02.376038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:55:02.376038 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:55:02.378234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:55:02.378234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 27 15:55:02.378234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 27 15:55:02.378234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04d5e0c6-2148-42b6-80f2-8c86f7d62e34 is not attached to volume cda986b2-b1cd-407a-a23a-cf82b1f10bf6 Jun 27 15:55:02.378234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:55:02.378234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:55:02.378234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:55:02.378234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:55:02.378234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:55:02.378234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:55:02.378234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:55:02.378234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:55:02.378234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04d5e0c6-2148-42b6-80f2-8c86f7d62e34 is not attached to volume cda986b2-b1cd-407a-a23a-cf82b1f10bf6 Jun 27 15:55:02.378234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:55:02.378234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-530f3961-b7e4-48c2-bcf5-9a0b57c533ad tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Returning 404 to user: Instance 04d5e0c6-2148-42b6-80f2-8c86f7d62e34 is not attached to volume cda986b2-b1cd-407a-a23a-cf82b1f10bf6 {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:55:02.380071 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-530f3961-b7e4-48c2-bcf5-9a0b57c533ad tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "DELETE /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34/os-volume_attachments/cda986b2-b1cd-407a-a23a-cf82b1f10bf6" status: 404 len: 154 microversion: 2.1 time: 0.117321 Jun 27 15:55:02.380071 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 425/858] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 27 15:55:02 2022] DELETE /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34/os-volume_attachments/cda986b2-b1cd-407a-a23a-cf82b1f10bf6 => generated 154 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:55:02.676172 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-bd2d4df2-f6ba-4d94-859f-7bfbdf40a744 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:02.676679 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-bd2d4df2-f6ba-4d94-859f-7bfbdf40a744 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:02.684147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bd2d4df2-f6ba-4d94-859f-7bfbdf40a744 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:02.684607 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bd2d4df2-f6ba-4d94-859f-7bfbdf40a744 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:02.685624 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bd2d4df2-f6ba-4d94-859f-7bfbdf40a744 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:02.686101 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bd2d4df2-f6ba-4d94-859f-7bfbdf40a744 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:02.848901 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-bd2d4df2-f6ba-4d94-859f-7bfbdf40a744 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:02.858718 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-bd2d4df2-f6ba-4d94-859f-7bfbdf40a744 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:02.860756 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-bd2d4df2-f6ba-4d94-859f-7bfbdf40a744 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:02.862126 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-bd2d4df2-f6ba-4d94-859f-7bfbdf40a744 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.190023 Jun 27 15:55:02.862750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 434/859] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:02 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:03.557415 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f00daa34-d4f8-4de9-b8be-679c63ed45c2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:03.558307 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f00daa34-d4f8-4de9-b8be-679c63ed45c2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:03.566928 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f00daa34-d4f8-4de9-b8be-679c63ed45c2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:03.567559 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f00daa34-d4f8-4de9-b8be-679c63ed45c2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:03.568564 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f00daa34-d4f8-4de9-b8be-679c63ed45c2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:03.569090 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f00daa34-d4f8-4de9-b8be-679c63ed45c2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:03.613477 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f00daa34-d4f8-4de9-b8be-679c63ed45c2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Going to try to terminate instance {{(pid=129472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:55:03.725772 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f00daa34-d4f8-4de9-b8be-679c63ed45c2 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "DELETE /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 204 len: 0 microversion: 2.1 time: 0.173969 Jun 27 15:55:03.726677 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 426/860] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:55:03 2022] DELETE /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:55:03.736765 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e8af0468-20ba-4ef7-9b3c-ed76e30b3d54 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:03.737831 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e8af0468-20ba-4ef7-9b3c-ed76e30b3d54 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:03.747834 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e8af0468-20ba-4ef7-9b3c-ed76e30b3d54 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:03.748658 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e8af0468-20ba-4ef7-9b3c-ed76e30b3d54 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:03.749629 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e8af0468-20ba-4ef7-9b3c-ed76e30b3d54 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:03.750170 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e8af0468-20ba-4ef7-9b3c-ed76e30b3d54 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:03.890398 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-0391d8e2-a115-40a2-bac4-c77b694fb2ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:03.895248 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-0391d8e2-a115-40a2-bac4-c77b694fb2ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:03.909075 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0391d8e2-a115-40a2-bac4-c77b694fb2ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:03.909672 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0391d8e2-a115-40a2-bac4-c77b694fb2ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:03.910857 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0391d8e2-a115-40a2-bac4-c77b694fb2ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:03.911587 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0391d8e2-a115-40a2-bac4-c77b694fb2ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:04.073168 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e8af0468-20ba-4ef7-9b3c-ed76e30b3d54 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:04.083416 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e8af0468-20ba-4ef7-9b3c-ed76e30b3d54 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1552 microversion: 2.1 time: 0.351341 Jun 27 15:55:04.084334 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 435/861] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:03 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1552 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:55:04.181428 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0391d8e2-a115-40a2-bac4-c77b694fb2ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:04.195079 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0391d8e2-a115-40a2-bac4-c77b694fb2ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:04.198306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0391d8e2-a115-40a2-bac4-c77b694fb2ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:04.200027 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-0391d8e2-a115-40a2-bac4-c77b694fb2ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.319855 Jun 27 15:55:04.200774 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 427/862] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:03 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:05.105527 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ecb71530-05a8-4fdb-89b6-bcf1ce9162bb tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:05.106451 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-ecb71530-05a8-4fdb-89b6-bcf1ce9162bb tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:05.114485 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ecb71530-05a8-4fdb-89b6-bcf1ce9162bb tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:05.115175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ecb71530-05a8-4fdb-89b6-bcf1ce9162bb tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:05.116153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ecb71530-05a8-4fdb-89b6-bcf1ce9162bb tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:05.116674 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ecb71530-05a8-4fdb-89b6-bcf1ce9162bb tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:05.237233 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d22fe138-9074-4ca6-bb3c-46971a4e1cd0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:05.239509 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d22fe138-9074-4ca6-bb3c-46971a4e1cd0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:05.253503 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d22fe138-9074-4ca6-bb3c-46971a4e1cd0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:05.254425 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d22fe138-9074-4ca6-bb3c-46971a4e1cd0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:05.256653 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d22fe138-9074-4ca6-bb3c-46971a4e1cd0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:05.257967 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d22fe138-9074-4ca6-bb3c-46971a4e1cd0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:05.380067 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-ecb71530-05a8-4fdb-89b6-bcf1ce9162bb tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:05.393676 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-ecb71530-05a8-4fdb-89b6-bcf1ce9162bb tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1552 microversion: 2.1 time: 0.292417 Jun 27 15:55:05.398774 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 436/863] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:05 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1552 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:55:05.476808 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d22fe138-9074-4ca6-bb3c-46971a4e1cd0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:05.492623 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d22fe138-9074-4ca6-bb3c-46971a4e1cd0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:05.496603 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d22fe138-9074-4ca6-bb3c-46971a4e1cd0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:05.498538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d22fe138-9074-4ca6-bb3c-46971a4e1cd0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.271743 Jun 27 15:55:05.500636 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 428/864] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:05 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:06.425968 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3f6cc9e1-6edf-4769-a36a-d6a0bf1dd67b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:06.427449 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3f6cc9e1-6edf-4769-a36a-d6a0bf1dd67b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:06.448085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3f6cc9e1-6edf-4769-a36a-d6a0bf1dd67b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:06.448750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3f6cc9e1-6edf-4769-a36a-d6a0bf1dd67b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:06.450029 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3f6cc9e1-6edf-4769-a36a-d6a0bf1dd67b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:06.451007 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3f6cc9e1-6edf-4769-a36a-d6a0bf1dd67b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:06.534639 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c1159a38-6283-47a3-ab2b-2d4ab37f4492 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:06.535683 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c1159a38-6283-47a3-ab2b-2d4ab37f4492 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:06.564165 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c1159a38-6283-47a3-ab2b-2d4ab37f4492 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:06.566686 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c1159a38-6283-47a3-ab2b-2d4ab37f4492 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:06.568511 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c1159a38-6283-47a3-ab2b-2d4ab37f4492 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:06.569469 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c1159a38-6283-47a3-ab2b-2d4ab37f4492 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:06.780937 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3f6cc9e1-6edf-4769-a36a-d6a0bf1dd67b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1320328d4bd04dc28c0c828a0f30e641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a070d552fee4594bbcf0ae7adc16f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:06.792117 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3f6cc9e1-6edf-4769-a36a-d6a0bf1dd67b tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 200 len: 1552 microversion: 2.1 time: 0.370333 Jun 27 15:55:06.792956 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 437/865] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:06 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 1552 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:55:06.845697 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-c1159a38-6283-47a3-ab2b-2d4ab37f4492 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:06.853111 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-967b47bb-b270-45d2-a29d-97b28bc13ca1 req-79b8bf25-8eb6-4e4d-8b6a-0866b7f97ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d5e0c6-2148-42b6-80f2-8c86f7d62e34", "name": "network-vif-deleted", "tag": "f3f58277-1227-4989-91cb-3c2473267d77"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:55:06.862402 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-c1159a38-6283-47a3-ab2b-2d4ab37f4492 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:06.864172 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-c1159a38-6283-47a3-ab2b-2d4ab37f4492 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:06.865417 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c1159a38-6283-47a3-ab2b-2d4ab37f4492 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.341207 Jun 27 15:55:06.866027 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 429/866] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:06 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:06.887279 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-967b47bb-b270-45d2-a29d-97b28bc13ca1 req-79b8bf25-8eb6-4e4d-8b6a-0866b7f97ca4 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:06.887877 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-967b47bb-b270-45d2-a29d-97b28bc13ca1 req-79b8bf25-8eb6-4e4d-8b6a-0866b7f97ca4 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:06.914289 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-967b47bb-b270-45d2-a29d-97b28bc13ca1 req-79b8bf25-8eb6-4e4d-8b6a-0866b7f97ca4 service nova] Creating event network-vif-deleted:f3f58277-1227-4989-91cb-3c2473267d77 for instance 04d5e0c6-2148-42b6-80f2-8c86f7d62e34 on hv-cinder-84780 Jun 27 15:55:06.922788 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-967b47bb-b270-45d2-a29d-97b28bc13ca1 req-79b8bf25-8eb6-4e4d-8b6a-0866b7f97ca4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099185 Jun 27 15:55:06.925091 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 438/867] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:55:07.818404 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-57fdf0a9-5f1e-4fea-982b-bda738c12cd8 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:07.819343 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-57fdf0a9-5f1e-4fea-982b-bda738c12cd8 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] [instance: 04d5e0c6-2148-42b6-80f2-8c86f7d62e34] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:07.832023 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-57fdf0a9-5f1e-4fea-982b-bda738c12cd8 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:07.832665 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-57fdf0a9-5f1e-4fea-982b-bda738c12cd8 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:07.833886 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-57fdf0a9-5f1e-4fea-982b-bda738c12cd8 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:07.834530 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-57fdf0a9-5f1e-4fea-982b-bda738c12cd8 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:07.861870 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-57fdf0a9-5f1e-4fea-982b-bda738c12cd8 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] HTTP exception thrown: Instance 04d5e0c6-2148-42b6-80f2-8c86f7d62e34 could not be found. Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-57fdf0a9-5f1e-4fea-982b-bda738c12cd8 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Request method failure captured: Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 HTTP/1.1 Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudJCd5lJBbrQKEJnL2Uj-y6VTbh7BwQ2F2o-o7AbsZWyegTt3WJCrct2v1b2u5Dv_GMnKlqqfK_MWb2TJZM3F2z19wT_aI-vnpV5gpSx2YiDSukMgwfpfiek1sLgmssNMoszL6gsrP5F-3ZYs44urNyKSry5UhBku7DC_sXOxIEvAdQ Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 6a070d552fee4594bbcf0ae7adc16f94 Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-TestMinimumBasicScenario-187184001 Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:55:07.865020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:55:07.866684 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a070d552fee4594bbcf0ae7adc16f94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a070d552fee4594bbcf0ae7adc16f94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a070d552fee4594bbcf0ae7adc16f94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a070d552fee4594bbcf0ae7adc16f94", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:55:07.866684 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-TestMinimumBasicScenario-187184001 Jun 27 15:55:07.866684 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 6a070d552fee4594bbcf0ae7adc16f94 Jun 27 15:55:07.866684 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-TestMinimumBasicScenario-187184001 Jun 27 15:55:07.866684 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-TestMinimumBasicScenario-187184001-project Jun 27 15:55:07.866684 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:55:07.866684 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:55:07.866684 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: 1320328d4bd04dc28c0c828a0f30e641 Jun 27 15:55:07.866684 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-TestMinimumBasicScenario-187184001-project Jun 27 15:55:07.866684 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:55:07.866684 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance 04d5e0c6-2148-42b6-80f2-8c86f7d62e34 could not be found. Jun 27 15:55:07.866684 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': '04d5e0c6-2148-42b6-80f2-8c86f7d62e34'} Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04d5e0c6-2148-42b6-80f2-8c86f7d62e34 could not be found. Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:55:07.867776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:55:07.871159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:55:07.871159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:55:07.871159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:55:07.871159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:55:07.871159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:55:07.871159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:55:07.871159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:55:07.871159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04d5e0c6-2148-42b6-80f2-8c86f7d62e34 could not be found. Jun 27 15:55:07.871159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:55:07.871159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:55:07.871159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:55:07.871159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:55:07.871159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:55:07.871159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:55:07.871159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:55:07.871159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:55:07.871159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04d5e0c6-2148-42b6-80f2-8c86f7d62e34 could not be found. Jun 27 15:55:07.871159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:55:07.874539 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-57fdf0a9-5f1e-4fea-982b-bda738c12cd8 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Returning 404 to user: Instance 04d5e0c6-2148-42b6-80f2-8c86f7d62e34 could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:55:07.874539 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-57fdf0a9-5f1e-4fea-982b-bda738c12cd8 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34" status: 404 len: 111 microversion: 2.1 time: 0.056057 Jun 27 15:55:07.874539 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 430/868] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:07 2022] GET /compute/v2.1/servers/04d5e0c6-2148-42b6-80f2-8c86f7d62e34 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:55:07.882720 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e8335fd3-ebb8-478d-9d38-180b6375a3b1 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] Calling method '.version_select at 0x7fe1464c6ee0>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:07.903445 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-0b70b9e2-f8bd-47cc-a7e4-d8129fba3724 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:07.903445 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-0b70b9e2-f8bd-47cc-a7e4-d8129fba3724 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:07.914533 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e8335fd3-ebb8-478d-9d38-180b6375a3b1 tempest-TestMinimumBasicScenario-187184001 tempest-TestMinimumBasicScenario-187184001-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1556187232" status: 202 len: 0 microversion: 2.1 time: 0.037879 Jun 27 15:55:07.915387 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0b70b9e2-f8bd-47cc-a7e4-d8129fba3724 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:07.916087 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 439/869] 10.222.0.20 () {58 vars in 1271 bytes} [Mon Jun 27 15:55:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1556187232 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:55:07.916283 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0b70b9e2-f8bd-47cc-a7e4-d8129fba3724 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:07.921540 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0b70b9e2-f8bd-47cc-a7e4-d8129fba3724 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:07.922343 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-0b70b9e2-f8bd-47cc-a7e4-d8129fba3724 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:08.182846 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0b70b9e2-f8bd-47cc-a7e4-d8129fba3724 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:08.207440 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0b70b9e2-f8bd-47cc-a7e4-d8129fba3724 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:08.210780 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-0b70b9e2-f8bd-47cc-a7e4-d8129fba3724 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:08.213934 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-0b70b9e2-f8bd-47cc-a7e4-d8129fba3724 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.318926 Jun 27 15:55:08.215054 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 431/870] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:07 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:09.242464 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-03985bef-0286-4f4b-866c-bfd0c61318c5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:09.248265 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-03985bef-0286-4f4b-866c-bfd0c61318c5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:09.262482 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-03985bef-0286-4f4b-866c-bfd0c61318c5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:09.272237 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-03985bef-0286-4f4b-866c-bfd0c61318c5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:09.274148 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-03985bef-0286-4f4b-866c-bfd0c61318c5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:09.276065 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-03985bef-0286-4f4b-866c-bfd0c61318c5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:09.598704 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-03985bef-0286-4f4b-866c-bfd0c61318c5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:09.619125 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-03985bef-0286-4f4b-866c-bfd0c61318c5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:09.622620 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-03985bef-0286-4f4b-866c-bfd0c61318c5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:09.626328 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-03985bef-0286-4f4b-866c-bfd0c61318c5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1745 microversion: 2.20 time: 0.389291 Jun 27 15:55:09.627449 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 440/871] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:09 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1745 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:55:10.656586 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ba4cde2b-a673-4605-9d50-2f879d9cfbe1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:10.657456 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-ba4cde2b-a673-4605-9d50-2f879d9cfbe1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:10.674322 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ba4cde2b-a673-4605-9d50-2f879d9cfbe1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:10.674768 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ba4cde2b-a673-4605-9d50-2f879d9cfbe1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:10.675957 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ba4cde2b-a673-4605-9d50-2f879d9cfbe1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:10.676563 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ba4cde2b-a673-4605-9d50-2f879d9cfbe1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:10.705898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:55:10.994153 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ba4cde2b-a673-4605-9d50-2f879d9cfbe1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:11.004178 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ba4cde2b-a673-4605-9d50-2f879d9cfbe1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:11.006261 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ba4cde2b-a673-4605-9d50-2f879d9cfbe1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:11.007904 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ba4cde2b-a673-4605-9d50-2f879d9cfbe1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1745 microversion: 2.20 time: 0.358783 Jun 27 15:55:11.020206 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 432/872] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:10 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1745 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:55:12.033070 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-55fb3215-b1a2-46ac-9d9a-1c5ef88d77d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:12.046570 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-55fb3215-b1a2-46ac-9d9a-1c5ef88d77d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:12.067194 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-55fb3215-b1a2-46ac-9d9a-1c5ef88d77d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:12.067996 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-55fb3215-b1a2-46ac-9d9a-1c5ef88d77d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:12.069473 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-55fb3215-b1a2-46ac-9d9a-1c5ef88d77d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:12.077354 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-55fb3215-b1a2-46ac-9d9a-1c5ef88d77d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:12.450604 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-55fb3215-b1a2-46ac-9d9a-1c5ef88d77d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:12.465495 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-55fb3215-b1a2-46ac-9d9a-1c5ef88d77d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:12.467941 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-55fb3215-b1a2-46ac-9d9a-1c5ef88d77d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:12.469480 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-55fb3215-b1a2-46ac-9d9a-1c5ef88d77d6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1740 microversion: 2.20 time: 0.444006 Jun 27 15:55:12.470699 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 441/873] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:12 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1740 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:13.504346 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-386633df-b0fe-4e46-87ab-9ce2aeced9ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:13.511732 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-386633df-b0fe-4e46-87ab-9ce2aeced9ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:13.571298 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-386633df-b0fe-4e46-87ab-9ce2aeced9ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:13.572330 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-386633df-b0fe-4e46-87ab-9ce2aeced9ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:13.573855 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-386633df-b0fe-4e46-87ab-9ce2aeced9ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:13.580106 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-386633df-b0fe-4e46-87ab-9ce2aeced9ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:13.954965 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-386633df-b0fe-4e46-87ab-9ce2aeced9ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:13.965614 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-386633df-b0fe-4e46-87ab-9ce2aeced9ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:13.975493 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-386633df-b0fe-4e46-87ab-9ce2aeced9ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:13.976753 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-386633df-b0fe-4e46-87ab-9ce2aeced9ca tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1740 microversion: 2.20 time: 0.479708 Jun 27 15:55:13.994315 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 433/874] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:13 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1740 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:14.043494 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c523e92b-51bb-4c57-9b05-1d40b4153242 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:14.044540 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c523e92b-51bb-4c57-9b05-1d40b4153242 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:14.100652 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c523e92b-51bb-4c57-9b05-1d40b4153242 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:14.105733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c523e92b-51bb-4c57-9b05-1d40b4153242 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:14.107565 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c523e92b-51bb-4c57-9b05-1d40b4153242 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:14.108567 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c523e92b-51bb-4c57-9b05-1d40b4153242 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:14.116560 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-19686bd8-a95c-4d8c-8f99-b399ef865320 req-6685b984-a733-445c-a39e-ce0fe2535f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a5fc50-738a-4228-9733-e9e7b34daccd", "name": "network-vif-plugged", "status": "completed", "tag": "c7c3302d-ee51-4be2-b345-2ab41cfc76b0"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:55:14.137894 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-19686bd8-a95c-4d8c-8f99-b399ef865320 req-6685b984-a733-445c-a39e-ce0fe2535f74 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:14.149710 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-19686bd8-a95c-4d8c-8f99-b399ef865320 req-6685b984-a733-445c-a39e-ce0fe2535f74 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:14.181320 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-19686bd8-a95c-4d8c-8f99-b399ef865320 req-6685b984-a733-445c-a39e-ce0fe2535f74 service nova] Creating event network-vif-plugged:c7c3302d-ee51-4be2-b345-2ab41cfc76b0 for instance 32a5fc50-738a-4228-9733-e9e7b34daccd on hv-cinder-84780 Jun 27 15:55:14.197563 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-19686bd8-a95c-4d8c-8f99-b399ef865320 req-6685b984-a733-445c-a39e-ce0fe2535f74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084628 Jun 27 15:55:14.202248 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 434/875] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:55:14.224869 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c523e92b-51bb-4c57-9b05-1d40b4153242 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa/ips" status: 200 len: 149 microversion: 2.1 time: 0.203130 Jun 27 15:55:14.226907 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 442/876] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 27 15:55:14 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa/ips => generated 149 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:55:15.043125 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-7e48c516-d8de-4120-84e3-2676e07904fe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:15.045968 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-7e48c516-d8de-4120-84e3-2676e07904fe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:15.056305 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:55:15.079831 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7e48c516-d8de-4120-84e3-2676e07904fe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:15.081118 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7e48c516-d8de-4120-84e3-2676e07904fe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:15.083055 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7e48c516-d8de-4120-84e3-2676e07904fe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:15.084600 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7e48c516-d8de-4120-84e3-2676e07904fe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:15.549313 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-7e48c516-d8de-4120-84e3-2676e07904fe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:15.567405 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-7e48c516-d8de-4120-84e3-2676e07904fe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:15.569554 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-7e48c516-d8de-4120-84e3-2676e07904fe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:15.571313 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-7e48c516-d8de-4120-84e3-2676e07904fe tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1740 microversion: 2.20 time: 0.563272 Jun 27 15:55:15.588528 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 435/877] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:15 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1740 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:16.428790 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c02d0bef-2ffc-4530-85c8-ca526b81aa99 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5afd6fa8-456c-4679-8ae1-a748709bfbce"}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:55:16.431269 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c02d0bef-2ffc-4530-85c8-ca526b81aa99 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:16.439194 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c02d0bef-2ffc-4530-85c8-ca526b81aa99 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:16.440009 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c02d0bef-2ffc-4530-85c8-ca526b81aa99 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:16.441061 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c02d0bef-2ffc-4530-85c8-ca526b81aa99 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:16.441752 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c02d0bef-2ffc-4530-85c8-ca526b81aa99 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:16.467762 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=100 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:55:16.596495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8794995f-a810-418a-8514-186cdbbb02eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:16.597407 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8794995f-a810-418a-8514-186cdbbb02eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:16.610390 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8794995f-a810-418a-8514-186cdbbb02eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:16.611322 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8794995f-a810-418a-8514-186cdbbb02eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:16.612530 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8794995f-a810-418a-8514-186cdbbb02eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:16.613255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8794995f-a810-418a-8514-186cdbbb02eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:17.084201 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c02d0bef-2ffc-4530-85c8-ca526b81aa99 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "POST /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.658845 Jun 27 15:55:17.087595 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 443/878] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 27 15:55:16 2022] POST /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa/os-volume_attachments => generated 194 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:55:17.147831 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8794995f-a810-418a-8514-186cdbbb02eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:17.160416 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8794995f-a810-418a-8514-186cdbbb02eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:17.163414 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8794995f-a810-418a-8514-186cdbbb02eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:17.167646 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-8794995f-a810-418a-8514-186cdbbb02eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1740 microversion: 2.20 time: 0.576476 Jun 27 15:55:17.186256 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 436/879] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:16 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1740 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:55:18.208754 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b6b6f7d1-6b97-42ff-ae7e-15b371c3b556 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:18.220704 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b6b6f7d1-6b97-42ff-ae7e-15b371c3b556 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:18.238266 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b6b6f7d1-6b97-42ff-ae7e-15b371c3b556 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:18.239523 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b6b6f7d1-6b97-42ff-ae7e-15b371c3b556 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:18.242055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b6b6f7d1-6b97-42ff-ae7e-15b371c3b556 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:18.249522 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b6b6f7d1-6b97-42ff-ae7e-15b371c3b556 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:18.647519 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b6b6f7d1-6b97-42ff-ae7e-15b371c3b556 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:18.669111 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b6b6f7d1-6b97-42ff-ae7e-15b371c3b556 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:18.673274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b6b6f7d1-6b97-42ff-ae7e-15b371c3b556 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:18.676255 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b6b6f7d1-6b97-42ff-ae7e-15b371c3b556 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1740 microversion: 2.20 time: 0.483821 Jun 27 15:55:18.699124 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 444/880] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:18 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1740 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:19.709297 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-14981c3f-6655-4d0b-abad-b927f8bf9798 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:19.710268 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-14981c3f-6655-4d0b-abad-b927f8bf9798 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:19.723763 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-14981c3f-6655-4d0b-abad-b927f8bf9798 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:19.724220 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-14981c3f-6655-4d0b-abad-b927f8bf9798 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:19.725030 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-14981c3f-6655-4d0b-abad-b927f8bf9798 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:19.725480 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-14981c3f-6655-4d0b-abad-b927f8bf9798 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:20.000706 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-14981c3f-6655-4d0b-abad-b927f8bf9798 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:20.021241 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-14981c3f-6655-4d0b-abad-b927f8bf9798 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:20.026436 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-14981c3f-6655-4d0b-abad-b927f8bf9798 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:20.029243 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-14981c3f-6655-4d0b-abad-b927f8bf9798 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1740 microversion: 2.20 time: 0.324587 Jun 27 15:55:20.043663 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 437/881] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:19 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1740 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:21.074367 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-dab2af50-ace2-4835-b2ec-7edc7a874b3c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:21.075915 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-dab2af50-ace2-4835-b2ec-7edc7a874b3c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:21.106927 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dab2af50-ace2-4835-b2ec-7edc7a874b3c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:21.107747 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dab2af50-ace2-4835-b2ec-7edc7a874b3c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:21.121045 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dab2af50-ace2-4835-b2ec-7edc7a874b3c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:21.124615 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dab2af50-ace2-4835-b2ec-7edc7a874b3c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:21.448020 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-dab2af50-ace2-4835-b2ec-7edc7a874b3c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:21.478987 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-dab2af50-ace2-4835-b2ec-7edc7a874b3c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:21.487146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-dab2af50-ace2-4835-b2ec-7edc7a874b3c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:21.490145 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-dab2af50-ace2-4835-b2ec-7edc7a874b3c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1740 microversion: 2.20 time: 0.431268 Jun 27 15:55:21.491947 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 445/882] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:21 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1740 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:22.513000 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8debe8dc-330e-4327-9963-7b391902de7a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:22.514056 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8debe8dc-330e-4327-9963-7b391902de7a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:22.529872 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8debe8dc-330e-4327-9963-7b391902de7a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:22.530872 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8debe8dc-330e-4327-9963-7b391902de7a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:22.535244 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8debe8dc-330e-4327-9963-7b391902de7a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:22.535244 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8debe8dc-330e-4327-9963-7b391902de7a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:22.889567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8debe8dc-330e-4327-9963-7b391902de7a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:22.901446 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8debe8dc-330e-4327-9963-7b391902de7a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:22.903030 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8debe8dc-330e-4327-9963-7b391902de7a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:22.913687 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-8debe8dc-330e-4327-9963-7b391902de7a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1740 microversion: 2.20 time: 0.402466 Jun 27 15:55:22.930646 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 438/883] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:22 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1740 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:23.944042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-536b56a1-5923-4722-8037-435998dd7b4c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:23.945967 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-536b56a1-5923-4722-8037-435998dd7b4c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:23.968187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-536b56a1-5923-4722-8037-435998dd7b4c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:23.968997 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-536b56a1-5923-4722-8037-435998dd7b4c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:23.970479 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-536b56a1-5923-4722-8037-435998dd7b4c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:23.971205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-536b56a1-5923-4722-8037-435998dd7b4c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:24.377222 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-536b56a1-5923-4722-8037-435998dd7b4c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:24.388073 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-536b56a1-5923-4722-8037-435998dd7b4c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:24.392953 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-536b56a1-5923-4722-8037-435998dd7b4c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:24.395708 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-536b56a1-5923-4722-8037-435998dd7b4c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1740 microversion: 2.20 time: 0.461982 Jun 27 15:55:24.398132 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 446/884] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:23 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1740 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:24.417576 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-4f354b78-9f73-484c-8e9e-1faefb908750 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Action: 'create', calling method: .version_select at 0x7fe14ac62550>, body: {"keypair": {"name": "tempest-keypair-346015505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEexSswjZwJbuT01gv/GW5IkPrv2rXSLzmTjaN4makk0nLwhfg2hA4OCYR+ZpF7dKuXXhFOvPbJyvKbCtpzUeJiINAVTQCD7/SdhhTDA4VgHN87sAy1XwC66hRZLNdh3xg=="}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:55:24.439301 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-4f354b78-9f73-484c-8e9e-1faefb908750 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Getting quotas for project 90d9fb4d2e024e6eac7eeee72e63e904. Resources: {'key_pairs'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:55:24.444887 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-4f354b78-9f73-484c-8e9e-1faefb908750 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Getting quotas for user ce59e0072f1c4b91a2825e5fecde7e23 and project 90d9fb4d2e024e6eac7eeee72e63e904. Resources: {'key_pairs'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:55:24.483021 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-4f354b78-9f73-484c-8e9e-1faefb908750 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069966 Jun 27 15:55:24.484713 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 439/885] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 27 15:55:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:55:25.430380 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b1dc53bd-97c4-4f9f-af8b-81d82363ab47 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:25.434544 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b1dc53bd-97c4-4f9f-af8b-81d82363ab47 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:25.464993 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b1dc53bd-97c4-4f9f-af8b-81d82363ab47 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:25.468676 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b1dc53bd-97c4-4f9f-af8b-81d82363ab47 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:25.474967 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b1dc53bd-97c4-4f9f-af8b-81d82363ab47 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:25.476432 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b1dc53bd-97c4-4f9f-af8b-81d82363ab47 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:25.874445 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b1dc53bd-97c4-4f9f-af8b-81d82363ab47 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:25.893229 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b1dc53bd-97c4-4f9f-af8b-81d82363ab47 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:25.896328 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b1dc53bd-97c4-4f9f-af8b-81d82363ab47 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:25.898304 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b1dc53bd-97c4-4f9f-af8b-81d82363ab47 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1740 microversion: 2.20 time: 0.476866 Jun 27 15:55:25.913407 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 447/886] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:25 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1740 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:26.922121 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-b3892fe2-bfdb-4de0-996f-0e6df0bc957b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:26.922748 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-b3892fe2-bfdb-4de0-996f-0e6df0bc957b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:26.934407 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b3892fe2-bfdb-4de0-996f-0e6df0bc957b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:26.934858 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b3892fe2-bfdb-4de0-996f-0e6df0bc957b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:26.935700 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b3892fe2-bfdb-4de0-996f-0e6df0bc957b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:26.936141 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-b3892fe2-bfdb-4de0-996f-0e6df0bc957b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:27.298829 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b3892fe2-bfdb-4de0-996f-0e6df0bc957b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:27.335374 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b3892fe2-bfdb-4de0-996f-0e6df0bc957b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:27.345862 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-b3892fe2-bfdb-4de0-996f-0e6df0bc957b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:27.348769 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-b3892fe2-bfdb-4de0-996f-0e6df0bc957b tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1740 microversion: 2.20 time: 0.432000 Jun 27 15:55:27.351020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 440/887] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:26 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1740 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:27.669594 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-08d49969-58a2-4f63-b2b1-c411aefe1aad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1991764202", "imageRef": "11f9be98-90d6-4c67-8d66-0b944f5a2a2b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db23eeee-31f0-406e-a989-356a481d9808"}], "security_groups": [{"name": "tempest-securitygroup--1158338849"}], "key_name": "tempest-keypair-346015505", "user_data": "}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:55:27.681282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:55:27.875937 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.network.neutron [None req-08d49969-58a2-4f63-b2b1-c411aefe1aad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] validate_networks() for [('db23eeee-31f0-406e-a989-356a481d9808', None, None, None, None, None)] {{(pid=129473) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:55:28.387216 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-09216852-9b7f-4ec1-926b-4e48aa36e4f9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:28.388324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-09216852-9b7f-4ec1-926b-4e48aa36e4f9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:28.401297 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-09216852-9b7f-4ec1-926b-4e48aa36e4f9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:28.401889 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-09216852-9b7f-4ec1-926b-4e48aa36e4f9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:28.402851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-09216852-9b7f-4ec1-926b-4e48aa36e4f9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:28.403703 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-09216852-9b7f-4ec1-926b-4e48aa36e4f9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:28.478242 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-08d49969-58a2-4f63-b2b1-c411aefe1aad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Flavor limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:55:28.480198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-08d49969-58a2-4f63-b2b1-c411aefe1aad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Image limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:55:28.480877 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-08d49969-58a2-4f63-b2b1-c411aefe1aad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Flavor pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:55:28.481893 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-08d49969-58a2-4f63-b2b1-c411aefe1aad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Image pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:55:28.482584 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-08d49969-58a2-4f63-b2b1-c411aefe1aad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:55:28.496878 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-08d49969-58a2-4f63-b2b1-c411aefe1aad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:28.497804 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-08d49969-58a2-4f63-b2b1-c411aefe1aad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:28.499082 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-08d49969-58a2-4f63-b2b1-c411aefe1aad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:28.499741 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-08d49969-58a2-4f63-b2b1-c411aefe1aad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:28.530387 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-08d49969-58a2-4f63-b2b1-c411aefe1aad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Getting quotas for project 90d9fb4d2e024e6eac7eeee72e63e904. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:55:28.543387 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-08d49969-58a2-4f63-b2b1-c411aefe1aad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Getting quotas for user ce59e0072f1c4b91a2825e5fecde7e23 and project 90d9fb4d2e024e6eac7eeee72e63e904. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:55:28.561171 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-08d49969-58a2-4f63-b2b1-c411aefe1aad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Going to run 1 instances... {{(pid=129473) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:55:28.564009 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-08d49969-58a2-4f63-b2b1-c411aefe1aad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11f9be98-90d6-4c67-8d66-0b944f5a2a2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:55:28.609850 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-09216852-9b7f-4ec1-926b-4e48aa36e4f9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:28.617076 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-08d49969-58a2-4f63-b2b1-c411aefe1aad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.955052 Jun 27 15:55:28.621737 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 448/888] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 15:55:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:55:28.621982 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-09216852-9b7f-4ec1-926b-4e48aa36e4f9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:28.621982 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-09216852-9b7f-4ec1-926b-4e48aa36e4f9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:28.623208 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-09216852-9b7f-4ec1-926b-4e48aa36e4f9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1740 microversion: 2.20 time: 0.243555 Jun 27 15:55:28.623792 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 441/889] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:28 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:55:28.636862 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c9ade1da-c80d-410d-b655-7c78ade2fac1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:28.638011 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c9ade1da-c80d-410d-b655-7c78ade2fac1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:28.709920 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-c9ade1da-c80d-410d-b655-7c78ade2fac1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:28.722369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c9ade1da-c80d-410d-b655-7c78ade2fac1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1241 microversion: 2.1 time: 0.095188 Jun 27 15:55:28.724107 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 449/890] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:28 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:55:29.646021 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-622df665-4203-4b93-ad51-3f63f5da3cda tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:29.647032 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-622df665-4203-4b93-ad51-3f63f5da3cda tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:29.658936 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-622df665-4203-4b93-ad51-3f63f5da3cda tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:29.659586 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-622df665-4203-4b93-ad51-3f63f5da3cda tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:29.660745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-622df665-4203-4b93-ad51-3f63f5da3cda tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:29.661228 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-622df665-4203-4b93-ad51-3f63f5da3cda tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:29.741042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c3ec534f-31df-4298-ae91-573e48f5de96 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:29.741668 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c3ec534f-31df-4298-ae91-573e48f5de96 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:29.749852 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c3ec534f-31df-4298-ae91-573e48f5de96 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:29.750354 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c3ec534f-31df-4298-ae91-573e48f5de96 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:29.751202 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c3ec534f-31df-4298-ae91-573e48f5de96 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:29.751726 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c3ec534f-31df-4298-ae91-573e48f5de96 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:29.877587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-c3ec534f-31df-4298-ae91-573e48f5de96 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:29.888484 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c3ec534f-31df-4298-ae91-573e48f5de96 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1293 microversion: 2.1 time: 0.151476 Jun 27 15:55:29.889323 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 450/891] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:29 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1293 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:55:29.914583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-622df665-4203-4b93-ad51-3f63f5da3cda tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:29.931348 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-622df665-4203-4b93-ad51-3f63f5da3cda tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:29.934478 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-622df665-4203-4b93-ad51-3f63f5da3cda tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:29.936741 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-622df665-4203-4b93-ad51-3f63f5da3cda tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1722 microversion: 2.20 time: 0.296403 Jun 27 15:55:29.937829 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 442/892] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:29 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:30.910319 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-db2d3965-273f-4785-bfec-252fe6c194c6 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:30.911361 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-db2d3965-273f-4785-bfec-252fe6c194c6 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:30.920726 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-db2d3965-273f-4785-bfec-252fe6c194c6 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:30.921415 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-db2d3965-273f-4785-bfec-252fe6c194c6 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:30.922359 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-db2d3965-273f-4785-bfec-252fe6c194c6 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:30.922946 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-db2d3965-273f-4785-bfec-252fe6c194c6 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:30.967158 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9ceebf20-4c4c-4201-ad24-cbc92bfc23e3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:30.968046 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9ceebf20-4c4c-4201-ad24-cbc92bfc23e3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:30.975094 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9ceebf20-4c4c-4201-ad24-cbc92bfc23e3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:30.975551 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9ceebf20-4c4c-4201-ad24-cbc92bfc23e3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:30.976372 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9ceebf20-4c4c-4201-ad24-cbc92bfc23e3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:30.977401 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9ceebf20-4c4c-4201-ad24-cbc92bfc23e3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:31.002831 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-db2d3965-273f-4785-bfec-252fe6c194c6 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:31.014440 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-db2d3965-273f-4785-bfec-252fe6c194c6 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1301 microversion: 2.1 time: 0.109168 Jun 27 15:55:31.018440 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 451/893] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:30 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1301 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:55:31.167318 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9ceebf20-4c4c-4201-ad24-cbc92bfc23e3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:31.177425 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9ceebf20-4c4c-4201-ad24-cbc92bfc23e3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:31.179410 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9ceebf20-4c4c-4201-ad24-cbc92bfc23e3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:31.181507 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9ceebf20-4c4c-4201-ad24-cbc92bfc23e3 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1722 microversion: 2.20 time: 0.218339 Jun 27 15:55:31.182311 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 443/894] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:30 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:55:32.046643 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-6fa373c2-d874-41f8-8ff5-745a236cb43f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:32.047717 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-6fa373c2-d874-41f8-8ff5-745a236cb43f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:32.063486 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6fa373c2-d874-41f8-8ff5-745a236cb43f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:32.064477 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6fa373c2-d874-41f8-8ff5-745a236cb43f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:32.065867 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6fa373c2-d874-41f8-8ff5-745a236cb43f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:32.067219 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6fa373c2-d874-41f8-8ff5-745a236cb43f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:32.171210 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-6fa373c2-d874-41f8-8ff5-745a236cb43f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:32.187810 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-6fa373c2-d874-41f8-8ff5-745a236cb43f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1299 microversion: 2.1 time: 0.149365 Jun 27 15:55:32.188969 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 452/895] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:32 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1299 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:55:32.205255 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-96d679a6-5d1d-4c63-9a04-1c7daa79834d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:32.206395 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-96d679a6-5d1d-4c63-9a04-1c7daa79834d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:32.219340 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-96d679a6-5d1d-4c63-9a04-1c7daa79834d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:32.219904 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-96d679a6-5d1d-4c63-9a04-1c7daa79834d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:32.221039 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-96d679a6-5d1d-4c63-9a04-1c7daa79834d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:32.221549 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-96d679a6-5d1d-4c63-9a04-1c7daa79834d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:32.376403 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-96d679a6-5d1d-4c63-9a04-1c7daa79834d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:32.390174 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-96d679a6-5d1d-4c63-9a04-1c7daa79834d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:32.391848 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-96d679a6-5d1d-4c63-9a04-1c7daa79834d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:32.393156 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-96d679a6-5d1d-4c63-9a04-1c7daa79834d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1665 microversion: 2.20 time: 0.195410 Jun 27 15:55:32.394065 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 444/896] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:32 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1665 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:32.413293 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-cf995b97-c67d-4939-aaff-7b3822f132f1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbcd6306-07e2-4055-9ffd-0587f1dd33f7"}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:55:32.414642 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-cf995b97-c67d-4939-aaff-7b3822f132f1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:32.422045 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cf995b97-c67d-4939-aaff-7b3822f132f1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:32.422404 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cf995b97-c67d-4939-aaff-7b3822f132f1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:32.423183 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cf995b97-c67d-4939-aaff-7b3822f132f1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:32.423724 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cf995b97-c67d-4939-aaff-7b3822f132f1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:32.850348 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-cf995b97-c67d-4939-aaff-7b3822f132f1 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "POST /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.439972 Jun 27 15:55:32.862904 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 453/897] 10.222.0.20 () {62 vars in 1363 bytes} [Mon Jun 27 15:55:32 2022] POST /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd/os-volume_attachments => generated 188 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:55:33.052390 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-371e76fe-05b9-4c38-aab1-24701845811f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:33.053439 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-371e76fe-05b9-4c38-aab1-24701845811f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:33.065434 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-371e76fe-05b9-4c38-aab1-24701845811f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:33.066236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-371e76fe-05b9-4c38-aab1-24701845811f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:33.067673 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-371e76fe-05b9-4c38-aab1-24701845811f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:33.068470 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-371e76fe-05b9-4c38-aab1-24701845811f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:33.207085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-bd8f1bac-2448-4d78-a6c5-6689e27d2190 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:33.207950 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-bd8f1bac-2448-4d78-a6c5-6689e27d2190 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:33.217176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bd8f1bac-2448-4d78-a6c5-6689e27d2190 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:33.217700 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bd8f1bac-2448-4d78-a6c5-6689e27d2190 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:33.218771 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bd8f1bac-2448-4d78-a6c5-6689e27d2190 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:33.219417 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bd8f1bac-2448-4d78-a6c5-6689e27d2190 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:33.475018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-371e76fe-05b9-4c38-aab1-24701845811f tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "DELETE /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd/os-volume_attachments/fbcd6306-07e2-4055-9ffd-0587f1dd33f7" status: 202 len: 0 microversion: 2.20 time: 0.426374 Jun 27 15:55:33.475018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 445/898] 10.222.0.20 () {60 vars in 1456 bytes} [Mon Jun 27 15:55:33 2022] DELETE /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd/os-volume_attachments/fbcd6306-07e2-4055-9ffd-0587f1dd33f7 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:55:33.526102 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-bd8f1bac-2448-4d78-a6c5-6689e27d2190 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:33.541373 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-bd8f1bac-2448-4d78-a6c5-6689e27d2190 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1367 microversion: 2.1 time: 0.338186 Jun 27 15:55:33.542210 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 454/899] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:33 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:55:33.562679 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-6ee2d9f2-1581-4caf-8088-055d3a7bf930 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:55:33.563268 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-6ee2d9f2-1581-4caf-8088-055d3a7bf930 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:33.571369 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6ee2d9f2-1581-4caf-8088-055d3a7bf930 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:33.571970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6ee2d9f2-1581-4caf-8088-055d3a7bf930 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:33.573134 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6ee2d9f2-1581-4caf-8088-055d3a7bf930 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:33.573831 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6ee2d9f2-1581-4caf-8088-055d3a7bf930 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:33.675882 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-af955dfe-4140-4fff-b465-1c39eece6db5 req-b4d28c61-9410-496e-9770-ba343a3aeea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f94baae-848b-491b-ba4e-56149f83856e", "tag": "26242c74-174c-420a-bf02-44c87527d15f"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:55:33.702533 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-af955dfe-4140-4fff-b465-1c39eece6db5 req-b4d28c61-9410-496e-9770-ba343a3aeea4 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:33.703107 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-af955dfe-4140-4fff-b465-1c39eece6db5 req-b4d28c61-9410-496e-9770-ba343a3aeea4 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:33.708253 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-6ee2d9f2-1581-4caf-8088-055d3a7bf930 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "POST /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd/action" status: 202 len: 0 microversion: 2.20 time: 0.148855 Jun 27 15:55:33.711724 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 446/900] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jun 27 15:55:33 2022] POST /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:55:33.738113 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ad79fd02-beeb-4829-a02a-667c3466cf20 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:33.741395 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-ad79fd02-beeb-4829-a02a-667c3466cf20 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:33.756891 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-af955dfe-4140-4fff-b465-1c39eece6db5 req-b4d28c61-9410-496e-9770-ba343a3aeea4 service nova] Creating event network-changed:26242c74-174c-420a-bf02-44c87527d15f for instance 8f94baae-848b-491b-ba4e-56149f83856e on hv-cinder-84780 Jun 27 15:55:33.760622 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ad79fd02-beeb-4829-a02a-667c3466cf20 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:33.762256 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ad79fd02-beeb-4829-a02a-667c3466cf20 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:33.763331 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ad79fd02-beeb-4829-a02a-667c3466cf20 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:33.765949 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ad79fd02-beeb-4829-a02a-667c3466cf20 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:33.792931 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-af955dfe-4140-4fff-b465-1c39eece6db5 req-b4d28c61-9410-496e-9770-ba343a3aeea4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121629 Jun 27 15:55:33.794820 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 455/901] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:55:33.810873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:55:33.869759 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-b5524a65-3eb3-463c-bc09-892a7eeb89df req-58d99a86-9abd-41f4-b560-d0790e0442dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a5fc50-738a-4228-9733-e9e7b34daccd", "name": "network-vif-unplugged", "status": "completed", "tag": "c7c3302d-ee51-4be2-b345-2ab41cfc76b0"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:55:33.894448 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-b5524a65-3eb3-463c-bc09-892a7eeb89df req-58d99a86-9abd-41f4-b560-d0790e0442dc service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:33.897254 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-b5524a65-3eb3-463c-bc09-892a7eeb89df req-58d99a86-9abd-41f4-b560-d0790e0442dc service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:33.922165 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.compute.server_external_events [req-b5524a65-3eb3-463c-bc09-892a7eeb89df req-58d99a86-9abd-41f4-b560-d0790e0442dc service nova] Unable to find a host for instance 32a5fc50-738a-4228-9733-e9e7b34daccd. Dropping event network-vif-unplugged {{(pid=129473) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 27 15:55:33.923129 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-b5524a65-3eb3-463c-bc09-892a7eeb89df req-58d99a86-9abd-41f4-b560-d0790e0442dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.063784 Jun 27 15:55:33.924138 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 456/902] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 66 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 27 15:55:34.042645 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ad79fd02-beeb-4829-a02a-667c3466cf20 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:34.066546 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ad79fd02-beeb-4829-a02a-667c3466cf20 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:34.068554 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ad79fd02-beeb-4829-a02a-667c3466cf20 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:34.070139 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ad79fd02-beeb-4829-a02a-667c3466cf20 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1673 microversion: 2.20 time: 0.348979 Jun 27 15:55:34.071834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 447/903] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:33 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1673 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:34.571854 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-dcce1049-d6dc-4d87-a0f3-ef87b3cd634a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:34.577817 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-dcce1049-d6dc-4d87-a0f3-ef87b3cd634a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:34.589607 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dcce1049-d6dc-4d87-a0f3-ef87b3cd634a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:34.590220 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dcce1049-d6dc-4d87-a0f3-ef87b3cd634a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:34.591437 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dcce1049-d6dc-4d87-a0f3-ef87b3cd634a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:34.592080 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dcce1049-d6dc-4d87-a0f3-ef87b3cd634a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:34.831227 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-dcce1049-d6dc-4d87-a0f3-ef87b3cd634a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:34.847779 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-dcce1049-d6dc-4d87-a0f3-ef87b3cd634a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1367 microversion: 2.1 time: 0.291345 Jun 27 15:55:34.853729 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 457/904] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:34 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:55:35.090684 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-959ce22d-b44e-495d-b950-d95872bee517 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:35.091320 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-959ce22d-b44e-495d-b950-d95872bee517 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:35.093725 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=4 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:55:35.100392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-959ce22d-b44e-495d-b950-d95872bee517 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:35.100841 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-959ce22d-b44e-495d-b950-d95872bee517 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:35.102237 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-959ce22d-b44e-495d-b950-d95872bee517 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:35.102762 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-959ce22d-b44e-495d-b950-d95872bee517 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:35.269952 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-959ce22d-b44e-495d-b950-d95872bee517 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:35.286697 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-959ce22d-b44e-495d-b950-d95872bee517 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:35.291434 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-959ce22d-b44e-495d-b950-d95872bee517 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:35.294231 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-959ce22d-b44e-495d-b950-d95872bee517 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1673 microversion: 2.20 time: 0.207493 Jun 27 15:55:35.295950 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 448/905] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:35 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1673 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:35.871276 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a74939c4-df15-4cf2-b6bd-e31e6f80dfcb tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:35.872292 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a74939c4-df15-4cf2-b6bd-e31e6f80dfcb tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:35.882023 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a74939c4-df15-4cf2-b6bd-e31e6f80dfcb tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:35.882468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a74939c4-df15-4cf2-b6bd-e31e6f80dfcb tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:35.884020 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a74939c4-df15-4cf2-b6bd-e31e6f80dfcb tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:35.885215 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a74939c4-df15-4cf2-b6bd-e31e6f80dfcb tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:36.134582 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-a74939c4-df15-4cf2-b6bd-e31e6f80dfcb tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:36.149670 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a74939c4-df15-4cf2-b6bd-e31e6f80dfcb tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1367 microversion: 2.1 time: 0.285003 Jun 27 15:55:36.150790 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 458/906] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:35 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:55:36.325734 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f900b5b0-1a3f-4604-abfa-492766a4c6af tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:36.327230 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f900b5b0-1a3f-4604-abfa-492766a4c6af tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:36.334605 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f900b5b0-1a3f-4604-abfa-492766a4c6af tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:36.335265 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f900b5b0-1a3f-4604-abfa-492766a4c6af tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:36.336635 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f900b5b0-1a3f-4604-abfa-492766a4c6af tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:36.337233 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f900b5b0-1a3f-4604-abfa-492766a4c6af tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:36.541073 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f900b5b0-1a3f-4604-abfa-492766a4c6af tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:36.555906 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f900b5b0-1a3f-4604-abfa-492766a4c6af tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:36.557688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f900b5b0-1a3f-4604-abfa-492766a4c6af tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:36.558970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f900b5b0-1a3f-4604-abfa-492766a4c6af tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1731 microversion: 2.20 time: 0.238973 Jun 27 15:55:36.559774 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 449/907] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:36 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:37.175931 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-88c126a7-7f3b-4c21-8932-ab2a4038e15f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:37.176594 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-88c126a7-7f3b-4c21-8932-ab2a4038e15f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:37.184660 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-88c126a7-7f3b-4c21-8932-ab2a4038e15f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:37.185123 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-88c126a7-7f3b-4c21-8932-ab2a4038e15f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:37.185932 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-88c126a7-7f3b-4c21-8932-ab2a4038e15f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:37.186382 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-88c126a7-7f3b-4c21-8932-ab2a4038e15f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:37.189425 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:55:37.367499 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-88c126a7-7f3b-4c21-8932-ab2a4038e15f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:37.376396 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-88c126a7-7f3b-4c21-8932-ab2a4038e15f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1367 microversion: 2.1 time: 0.204588 Jun 27 15:55:37.377172 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 459/908] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:37 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:55:37.579639 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-7b85db51-872f-465e-809c-c67712e75a12 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:37.580469 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-7b85db51-872f-465e-809c-c67712e75a12 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:37.588588 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7b85db51-872f-465e-809c-c67712e75a12 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:37.589041 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7b85db51-872f-465e-809c-c67712e75a12 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:37.589864 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7b85db51-872f-465e-809c-c67712e75a12 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:37.590308 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-7b85db51-872f-465e-809c-c67712e75a12 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:37.789845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-7b85db51-872f-465e-809c-c67712e75a12 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:37.799511 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-7b85db51-872f-465e-809c-c67712e75a12 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:37.801438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-7b85db51-872f-465e-809c-c67712e75a12 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:37.802805 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-7b85db51-872f-465e-809c-c67712e75a12 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1731 microversion: 2.20 time: 0.228027 Jun 27 15:55:37.803505 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 450/909] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:37 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1731 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:38.399336 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-fc18aa40-2a60-48f9-b218-c075ba127c3f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:38.401241 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-fc18aa40-2a60-48f9-b218-c075ba127c3f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:38.409770 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fc18aa40-2a60-48f9-b218-c075ba127c3f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:38.410569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fc18aa40-2a60-48f9-b218-c075ba127c3f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:38.411379 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fc18aa40-2a60-48f9-b218-c075ba127c3f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:38.411815 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fc18aa40-2a60-48f9-b218-c075ba127c3f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:38.513540 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=2 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:55:38.669896 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-fc18aa40-2a60-48f9-b218-c075ba127c3f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:38.687299 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-fc18aa40-2a60-48f9-b218-c075ba127c3f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1367 microversion: 2.1 time: 0.295442 Jun 27 15:55:38.698295 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 460/910] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:38 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:55:38.831359 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-4474b896-08b6-492f-afc0-a6bfab970b0a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:38.831981 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-4474b896-08b6-492f-afc0-a6bfab970b0a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:38.848162 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4474b896-08b6-492f-afc0-a6bfab970b0a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:38.848615 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4474b896-08b6-492f-afc0-a6bfab970b0a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:38.849425 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4474b896-08b6-492f-afc0-a6bfab970b0a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:38.849905 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4474b896-08b6-492f-afc0-a6bfab970b0a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:39.148804 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-4474b896-08b6-492f-afc0-a6bfab970b0a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:39.159788 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-4474b896-08b6-492f-afc0-a6bfab970b0a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:39.161485 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-4474b896-08b6-492f-afc0-a6bfab970b0a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:39.162699 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-4474b896-08b6-492f-afc0-a6bfab970b0a tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1731 microversion: 2.20 time: 0.339941 Jun 27 15:55:39.173797 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 451/911] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:38 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1731 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:55:39.714279 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d061568f-3c72-44ee-9959-09cedc308088 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:39.714895 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d061568f-3c72-44ee-9959-09cedc308088 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:39.716879 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=8 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:55:39.723121 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d061568f-3c72-44ee-9959-09cedc308088 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:39.723585 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d061568f-3c72-44ee-9959-09cedc308088 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:39.724352 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d061568f-3c72-44ee-9959-09cedc308088 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:39.724806 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d061568f-3c72-44ee-9959-09cedc308088 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:39.940329 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d061568f-3c72-44ee-9959-09cedc308088 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:39.959434 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d061568f-3c72-44ee-9959-09cedc308088 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1367 microversion: 2.1 time: 0.250272 Jun 27 15:55:39.961483 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 461/912] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:39 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:55:40.200158 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-dea0e73e-e899-4042-902b-2313c5ae03a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:40.201261 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-dea0e73e-e899-4042-902b-2313c5ae03a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:40.217722 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dea0e73e-e899-4042-902b-2313c5ae03a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:40.217722 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dea0e73e-e899-4042-902b-2313c5ae03a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:40.218571 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dea0e73e-e899-4042-902b-2313c5ae03a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:40.219371 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-dea0e73e-e899-4042-902b-2313c5ae03a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:40.476876 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-dea0e73e-e899-4042-902b-2313c5ae03a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:40.488837 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-dea0e73e-e899-4042-902b-2313c5ae03a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:40.493495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-dea0e73e-e899-4042-902b-2313c5ae03a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:40.495182 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-dea0e73e-e899-4042-902b-2313c5ae03a0 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1731 microversion: 2.20 time: 0.306614 Jun 27 15:55:40.496205 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 452/913] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:40 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1731 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:40.982847 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f5b9fdd8-e57d-46af-8a85-bfb122b5a8d7 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:40.984837 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f5b9fdd8-e57d-46af-8a85-bfb122b5a8d7 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:41.001993 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f5b9fdd8-e57d-46af-8a85-bfb122b5a8d7 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:41.002733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f5b9fdd8-e57d-46af-8a85-bfb122b5a8d7 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:41.004066 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f5b9fdd8-e57d-46af-8a85-bfb122b5a8d7 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:41.004796 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f5b9fdd8-e57d-46af-8a85-bfb122b5a8d7 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:41.216335 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f5b9fdd8-e57d-46af-8a85-bfb122b5a8d7 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:41.236182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f5b9fdd8-e57d-46af-8a85-bfb122b5a8d7 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1367 microversion: 2.1 time: 0.261582 Jun 27 15:55:41.238133 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 462/914] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:40 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:55:41.519748 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-abc6ad89-8152-4825-be81-7aa42c7031ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:41.520983 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-abc6ad89-8152-4825-be81-7aa42c7031ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:41.533014 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-abc6ad89-8152-4825-be81-7aa42c7031ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:41.533171 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-abc6ad89-8152-4825-be81-7aa42c7031ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:41.535004 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-abc6ad89-8152-4825-be81-7aa42c7031ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:41.535921 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-abc6ad89-8152-4825-be81-7aa42c7031ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:41.783037 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-abc6ad89-8152-4825-be81-7aa42c7031ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:41.793515 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-abc6ad89-8152-4825-be81-7aa42c7031ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:41.795249 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-abc6ad89-8152-4825-be81-7aa42c7031ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:41.796849 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-abc6ad89-8152-4825-be81-7aa42c7031ed tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1731 microversion: 2.20 time: 0.283970 Jun 27 15:55:41.797508 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 453/915] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:41 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1731 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:42.123841 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-9443a64a-8079-4539-9b77-15c82b53289b req-e903bd4b-dcf0-471d-8280-bd81de826c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f94baae-848b-491b-ba4e-56149f83856e", "name": "network-vif-plugged", "status": "completed", "tag": "26242c74-174c-420a-bf02-44c87527d15f"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:55:42.142441 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-9443a64a-8079-4539-9b77-15c82b53289b req-e903bd4b-dcf0-471d-8280-bd81de826c0d service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:42.142944 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-9443a64a-8079-4539-9b77-15c82b53289b req-e903bd4b-dcf0-471d-8280-bd81de826c0d service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:42.158812 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-9443a64a-8079-4539-9b77-15c82b53289b req-e903bd4b-dcf0-471d-8280-bd81de826c0d service nova] Creating event network-vif-plugged:26242c74-174c-420a-bf02-44c87527d15f for instance 8f94baae-848b-491b-ba4e-56149f83856e on hv-cinder-84780 Jun 27 15:55:42.169256 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-9443a64a-8079-4539-9b77-15c82b53289b req-e903bd4b-dcf0-471d-8280-bd81de826c0d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053297 Jun 27 15:55:42.172259 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 463/916] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:55:42.258539 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a9dae82f-3cf7-483a-a163-2c77aa397bd0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:42.259745 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a9dae82f-3cf7-483a-a163-2c77aa397bd0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:42.269409 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a9dae82f-3cf7-483a-a163-2c77aa397bd0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:42.270480 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a9dae82f-3cf7-483a-a163-2c77aa397bd0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:42.271583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a9dae82f-3cf7-483a-a163-2c77aa397bd0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:42.272357 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a9dae82f-3cf7-483a-a163-2c77aa397bd0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:42.502610 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a9dae82f-3cf7-483a-a163-2c77aa397bd0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:42.514963 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-a9dae82f-3cf7-483a-a163-2c77aa397bd0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1367 microversion: 2.1 time: 0.261998 Jun 27 15:55:42.515845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 454/917] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:42 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:55:42.827160 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3bd48206-51c3-46eb-9f97-8fa33b2317cc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:42.833001 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3bd48206-51c3-46eb-9f97-8fa33b2317cc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:42.846158 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3bd48206-51c3-46eb-9f97-8fa33b2317cc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:42.846890 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3bd48206-51c3-46eb-9f97-8fa33b2317cc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:42.848209 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3bd48206-51c3-46eb-9f97-8fa33b2317cc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:42.848941 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3bd48206-51c3-46eb-9f97-8fa33b2317cc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:43.140131 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3bd48206-51c3-46eb-9f97-8fa33b2317cc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:43.166555 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3bd48206-51c3-46eb-9f97-8fa33b2317cc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:43.170614 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3bd48206-51c3-46eb-9f97-8fa33b2317cc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:43.172911 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3bd48206-51c3-46eb-9f97-8fa33b2317cc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1731 microversion: 2.20 time: 0.356478 Jun 27 15:55:43.174621 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 464/918] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:42 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1731 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:43.540361 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-32bcceba-4df9-4900-9e09-e6644d863cf9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:43.541081 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-32bcceba-4df9-4900-9e09-e6644d863cf9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:43.551052 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-32bcceba-4df9-4900-9e09-e6644d863cf9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:43.551605 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-32bcceba-4df9-4900-9e09-e6644d863cf9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:43.552455 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-32bcceba-4df9-4900-9e09-e6644d863cf9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:43.553048 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-32bcceba-4df9-4900-9e09-e6644d863cf9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:43.790948 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-32bcceba-4df9-4900-9e09-e6644d863cf9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:43.806552 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-32bcceba-4df9-4900-9e09-e6644d863cf9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1367 microversion: 2.1 time: 0.270209 Jun 27 15:55:43.807621 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 455/919] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:43 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:55:44.204077 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-42f112c5-6a0e-44e3-a24c-1de97d002edc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:44.206935 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-42f112c5-6a0e-44e3-a24c-1de97d002edc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:44.223995 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-42f112c5-6a0e-44e3-a24c-1de97d002edc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:44.224892 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-42f112c5-6a0e-44e3-a24c-1de97d002edc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:44.226730 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-42f112c5-6a0e-44e3-a24c-1de97d002edc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:44.227876 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-42f112c5-6a0e-44e3-a24c-1de97d002edc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:44.621750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-42f112c5-6a0e-44e3-a24c-1de97d002edc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:44.636124 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-42f112c5-6a0e-44e3-a24c-1de97d002edc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:44.639405 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-42f112c5-6a0e-44e3-a24c-1de97d002edc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:44.641695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-42f112c5-6a0e-44e3-a24c-1de97d002edc tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1731 microversion: 2.20 time: 0.447634 Jun 27 15:55:44.643134 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 465/920] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:44 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1731 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:44.832232 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-368d666a-8001-4437-a2fe-2009d18bdf5d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:44.833916 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-368d666a-8001-4437-a2fe-2009d18bdf5d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:44.847144 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-368d666a-8001-4437-a2fe-2009d18bdf5d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:44.848660 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-368d666a-8001-4437-a2fe-2009d18bdf5d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:44.850856 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-368d666a-8001-4437-a2fe-2009d18bdf5d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:44.853364 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-368d666a-8001-4437-a2fe-2009d18bdf5d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:45.125237 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-368d666a-8001-4437-a2fe-2009d18bdf5d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:45.135724 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-368d666a-8001-4437-a2fe-2009d18bdf5d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1367 microversion: 2.1 time: 0.313591 Jun 27 15:55:45.136413 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 456/921] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:44 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:55:45.673981 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-30fced82-d76b-4f38-b37b-c9e02182b8d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:45.675792 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-30fced82-d76b-4f38-b37b-c9e02182b8d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:45.686526 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-30fced82-d76b-4f38-b37b-c9e02182b8d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:45.687656 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-30fced82-d76b-4f38-b37b-c9e02182b8d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:45.688637 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-30fced82-d76b-4f38-b37b-c9e02182b8d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:45.689084 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-30fced82-d76b-4f38-b37b-c9e02182b8d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:45.991427 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-30fced82-d76b-4f38-b37b-c9e02182b8d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:46.006070 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-30fced82-d76b-4f38-b37b-c9e02182b8d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:46.008876 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-30fced82-d76b-4f38-b37b-c9e02182b8d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:46.010182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-30fced82-d76b-4f38-b37b-c9e02182b8d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1731 microversion: 2.20 time: 0.341381 Jun 27 15:55:46.010758 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 466/922] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:45 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1731 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:55:46.156335 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-4fc64fe7-5f06-4c0f-852d-f8e839ca9ae5 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:46.157163 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-4fc64fe7-5f06-4c0f-852d-f8e839ca9ae5 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:46.159523 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:55:46.167442 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4fc64fe7-5f06-4c0f-852d-f8e839ca9ae5 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:46.167902 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4fc64fe7-5f06-4c0f-852d-f8e839ca9ae5 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:46.168795 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4fc64fe7-5f06-4c0f-852d-f8e839ca9ae5 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:46.169233 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4fc64fe7-5f06-4c0f-852d-f8e839ca9ae5 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:46.364362 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-4fc64fe7-5f06-4c0f-852d-f8e839ca9ae5 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:46.374493 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-4fc64fe7-5f06-4c0f-852d-f8e839ca9ae5 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1367 microversion: 2.1 time: 0.222915 Jun 27 15:55:46.375087 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 457/923] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:46 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:55:47.035412 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e9510e0a-2633-4cf1-838b-7b09bb92535d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:47.036548 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e9510e0a-2633-4cf1-838b-7b09bb92535d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:47.049484 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e9510e0a-2633-4cf1-838b-7b09bb92535d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:47.050468 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e9510e0a-2633-4cf1-838b-7b09bb92535d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:47.052182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e9510e0a-2633-4cf1-838b-7b09bb92535d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:47.054205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e9510e0a-2633-4cf1-838b-7b09bb92535d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:47.261540 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e9510e0a-2633-4cf1-838b-7b09bb92535d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:47.272550 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e9510e0a-2633-4cf1-838b-7b09bb92535d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:47.275991 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e9510e0a-2633-4cf1-838b-7b09bb92535d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:47.277934 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e9510e0a-2633-4cf1-838b-7b09bb92535d tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1731 microversion: 2.20 time: 0.250123 Jun 27 15:55:47.278691 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 467/924] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:47 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1731 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:55:47.398732 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-14bc3389-3a4b-4465-b415-f246ba508f92 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:47.399982 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-14bc3389-3a4b-4465-b415-f246ba508f92 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:47.407716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-14bc3389-3a4b-4465-b415-f246ba508f92 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:47.408162 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-14bc3389-3a4b-4465-b415-f246ba508f92 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:47.408962 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-14bc3389-3a4b-4465-b415-f246ba508f92 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:47.409400 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-14bc3389-3a4b-4465-b415-f246ba508f92 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:47.603605 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-14bc3389-3a4b-4465-b415-f246ba508f92 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:47.613595 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-14bc3389-3a4b-4465-b415-f246ba508f92 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1367 microversion: 2.1 time: 0.222518 Jun 27 15:55:47.614028 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 458/925] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:47 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:55:48.299024 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f4995c25-2fc4-4815-8e09-9549b63a98d2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:48.299620 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f4995c25-2fc4-4815-8e09-9549b63a98d2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:48.307933 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f4995c25-2fc4-4815-8e09-9549b63a98d2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:48.308383 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f4995c25-2fc4-4815-8e09-9549b63a98d2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:48.309184 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f4995c25-2fc4-4815-8e09-9549b63a98d2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:48.309629 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f4995c25-2fc4-4815-8e09-9549b63a98d2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:48.478596 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f4995c25-2fc4-4815-8e09-9549b63a98d2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:48.487475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f4995c25-2fc4-4815-8e09-9549b63a98d2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:48.489028 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f4995c25-2fc4-4815-8e09-9549b63a98d2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:48.490276 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f4995c25-2fc4-4815-8e09-9549b63a98d2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1731 microversion: 2.20 time: 0.195813 Jun 27 15:55:48.490877 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 468/926] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:48 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:55:48.636672 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c2fc2029-6d62-43fc-b271-df8c168f48fa tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:48.637310 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c2fc2029-6d62-43fc-b271-df8c168f48fa tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:48.644619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c2fc2029-6d62-43fc-b271-df8c168f48fa tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:48.645066 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c2fc2029-6d62-43fc-b271-df8c168f48fa tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:48.645969 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c2fc2029-6d62-43fc-b271-df8c168f48fa tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:48.646399 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c2fc2029-6d62-43fc-b271-df8c168f48fa tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:49.166117 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-c2fc2029-6d62-43fc-b271-df8c168f48fa tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:49.174958 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c2fc2029-6d62-43fc-b271-df8c168f48fa tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1367 microversion: 2.1 time: 0.543873 Jun 27 15:55:49.175618 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 459/927] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:48 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1367 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:55:49.513449 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-579c6471-add2-4947-a983-8407a45f0859 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:49.514138 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-579c6471-add2-4947-a983-8407a45f0859 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:49.521334 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-579c6471-add2-4947-a983-8407a45f0859 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:49.521824 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-579c6471-add2-4947-a983-8407a45f0859 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:49.523191 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-579c6471-add2-4947-a983-8407a45f0859 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:49.523638 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-579c6471-add2-4947-a983-8407a45f0859 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:49.699229 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-579c6471-add2-4947-a983-8407a45f0859 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:49.707074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-579c6471-add2-4947-a983-8407a45f0859 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:49.708629 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-579c6471-add2-4947-a983-8407a45f0859 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:49.709912 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-579c6471-add2-4947-a983-8407a45f0859 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1731 microversion: 2.20 time: 0.201505 Jun 27 15:55:49.710871 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 469/928] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:49 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:50.199213 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-6fcc3ace-f24f-4ccb-b562-e5d5f1bacf0c tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:50.200565 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-6fcc3ace-f24f-4ccb-b562-e5d5f1bacf0c tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:50.215789 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6fcc3ace-f24f-4ccb-b562-e5d5f1bacf0c tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:50.216355 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6fcc3ace-f24f-4ccb-b562-e5d5f1bacf0c tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:50.218410 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6fcc3ace-f24f-4ccb-b562-e5d5f1bacf0c tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:50.219653 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6fcc3ace-f24f-4ccb-b562-e5d5f1bacf0c tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:50.417678 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-6fcc3ace-f24f-4ccb-b562-e5d5f1bacf0c tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:50.428584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-6fcc3ace-f24f-4ccb-b562-e5d5f1bacf0c tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1556 microversion: 2.1 time: 0.238432 Jun 27 15:55:50.429316 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 460/929] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:55:50 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1556 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:55:50.457142 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0a641040-9be0-4b72-9a58-b01a147a58dc tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:50.458103 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-0a641040-9be0-4b72-9a58-b01a147a58dc tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:50.470114 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0a641040-9be0-4b72-9a58-b01a147a58dc tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:50.470754 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0a641040-9be0-4b72-9a58-b01a147a58dc tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:50.472224 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0a641040-9be0-4b72-9a58-b01a147a58dc tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:50.473008 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0a641040-9be0-4b72-9a58-b01a147a58dc tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:50.627136 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-0a641040-9be0-4b72-9a58-b01a147a58dc tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.177226 Jun 27 15:55:50.628815 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 470/930] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jun 27 15:55:50 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e/os-interface => generated 284 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:55:50.734202 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-e1e14b9d-fa47-4399-b9d3-6fb85d77bfe6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:50.735575 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-e1e14b9d-fa47-4399-b9d3-6fb85d77bfe6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:50.753528 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e1e14b9d-fa47-4399-b9d3-6fb85d77bfe6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:50.754365 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e1e14b9d-fa47-4399-b9d3-6fb85d77bfe6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:50.755819 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e1e14b9d-fa47-4399-b9d3-6fb85d77bfe6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:50.756865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e1e14b9d-fa47-4399-b9d3-6fb85d77bfe6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:50.961218 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-e1e14b9d-fa47-4399-b9d3-6fb85d77bfe6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:50.970462 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-e1e14b9d-fa47-4399-b9d3-6fb85d77bfe6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:50.972026 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-e1e14b9d-fa47-4399-b9d3-6fb85d77bfe6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:50.973282 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-e1e14b9d-fa47-4399-b9d3-6fb85d77bfe6 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1731 microversion: 2.20 time: 0.245897 Jun 27 15:55:50.974078 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 461/931] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:50 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1731 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:55:51.998660 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f4833622-4532-4280-a947-0954be1c9dea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:52.000033 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f4833622-4532-4280-a947-0954be1c9dea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:52.007853 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f4833622-4532-4280-a947-0954be1c9dea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:52.008388 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f4833622-4532-4280-a947-0954be1c9dea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:52.009866 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f4833622-4532-4280-a947-0954be1c9dea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:52.010419 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f4833622-4532-4280-a947-0954be1c9dea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:52.097955 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-251e6fc3-c88e-4def-a9d6-d356a36bd199 req-76e85829-a2aa-4c9d-bf58-16e2e4f33478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a5fc50-738a-4228-9733-e9e7b34daccd", "name": "network-vif-plugged", "status": "completed", "tag": "c7c3302d-ee51-4be2-b345-2ab41cfc76b0"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:55:52.118296 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-251e6fc3-c88e-4def-a9d6-d356a36bd199 req-76e85829-a2aa-4c9d-bf58-16e2e4f33478 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:52.119173 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-251e6fc3-c88e-4def-a9d6-d356a36bd199 req-76e85829-a2aa-4c9d-bf58-16e2e4f33478 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:52.147797 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-251e6fc3-c88e-4def-a9d6-d356a36bd199 req-76e85829-a2aa-4c9d-bf58-16e2e4f33478 service nova] Creating event network-vif-plugged:c7c3302d-ee51-4be2-b345-2ab41cfc76b0 for instance 32a5fc50-738a-4228-9733-e9e7b34daccd on hv-cinder-84780 Jun 27 15:55:52.160701 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-251e6fc3-c88e-4def-a9d6-d356a36bd199 req-76e85829-a2aa-4c9d-bf58-16e2e4f33478 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066925 Jun 27 15:55:52.161945 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 462/932] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:55:52.201222 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f4833622-4532-4280-a947-0954be1c9dea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:52.222816 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f4833622-4532-4280-a947-0954be1c9dea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:52.228988 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f4833622-4532-4280-a947-0954be1c9dea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:52.229774 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-7fb75164-7276-4be2-bcf6-cd2a269d87a0 req-7e547160-6240-4a16-b631-893f949a02f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f94baae-848b-491b-ba4e-56149f83856e", "tag": "26242c74-174c-420a-bf02-44c87527d15f"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:55:52.237016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f4833622-4532-4280-a947-0954be1c9dea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1731 microversion: 2.20 time: 0.244080 Jun 27 15:55:52.247338 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-7fb75164-7276-4be2-bcf6-cd2a269d87a0 req-7e547160-6240-4a16-b631-893f949a02f7 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:52.248084 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-7fb75164-7276-4be2-bcf6-cd2a269d87a0 req-7e547160-6240-4a16-b631-893f949a02f7 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:52.253802 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 471/933] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:51 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1731 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:52.264007 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-7fb75164-7276-4be2-bcf6-cd2a269d87a0 req-7e547160-6240-4a16-b631-893f949a02f7 service nova] Creating event network-changed:26242c74-174c-420a-bf02-44c87527d15f for instance 8f94baae-848b-491b-ba4e-56149f83856e on hv-cinder-84780 Jun 27 15:55:52.270505 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-7fb75164-7276-4be2-bcf6-cd2a269d87a0 req-7e547160-6240-4a16-b631-893f949a02f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051770 Jun 27 15:55:52.276462 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 463/934] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:55:53.273122 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-2511ad1f-7067-4511-9bd5-3437263d7df5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:53.274015 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-2511ad1f-7067-4511-9bd5-3437263d7df5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:53.280973 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2511ad1f-7067-4511-9bd5-3437263d7df5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:53.281421 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2511ad1f-7067-4511-9bd5-3437263d7df5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:53.282485 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2511ad1f-7067-4511-9bd5-3437263d7df5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:53.283117 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2511ad1f-7067-4511-9bd5-3437263d7df5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:53.457312 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2511ad1f-7067-4511-9bd5-3437263d7df5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:53.471545 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2511ad1f-7067-4511-9bd5-3437263d7df5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:53.474325 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2511ad1f-7067-4511-9bd5-3437263d7df5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:53.476628 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-2511ad1f-7067-4511-9bd5-3437263d7df5 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1731 microversion: 2.20 time: 0.206956 Jun 27 15:55:53.477608 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 472/935] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:53 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:54.504947 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-40925aa1-e318-43e7-b5f8-5d5af93e7aea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:54.505705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-40925aa1-e318-43e7-b5f8-5d5af93e7aea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:54.513155 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-40925aa1-e318-43e7-b5f8-5d5af93e7aea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:54.513603 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-40925aa1-e318-43e7-b5f8-5d5af93e7aea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:54.514419 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-40925aa1-e318-43e7-b5f8-5d5af93e7aea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:54.514860 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-40925aa1-e318-43e7-b5f8-5d5af93e7aea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:54.697112 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-40925aa1-e318-43e7-b5f8-5d5af93e7aea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:54.708379 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-40925aa1-e318-43e7-b5f8-5d5af93e7aea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:54.711166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-40925aa1-e318-43e7-b5f8-5d5af93e7aea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:54.712593 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-40925aa1-e318-43e7-b5f8-5d5af93e7aea tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1731 microversion: 2.20 time: 0.212960 Jun 27 15:55:54.713298 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 464/936] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:54 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1731 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:55:55.733171 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-445aeb37-84f3-43be-ac34-284231b171c2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:55:55.733997 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-445aeb37-84f3-43be-ac34-284231b171c2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:55:55.743552 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-445aeb37-84f3-43be-ac34-284231b171c2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:55.744370 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-445aeb37-84f3-43be-ac34-284231b171c2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:55.745853 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-445aeb37-84f3-43be-ac34-284231b171c2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:55:55.746679 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-445aeb37-84f3-43be-ac34-284231b171c2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:55:56.095651 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-445aeb37-84f3-43be-ac34-284231b171c2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:56.105094 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-445aeb37-84f3-43be-ac34-284231b171c2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:56.107364 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-445aeb37-84f3-43be-ac34-284231b171c2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:55:56.108840 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-445aeb37-84f3-43be-ac34-284231b171c2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1718 microversion: 2.20 time: 0.380105 Jun 27 15:55:56.109502 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 473/937] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:55:55 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1718 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:56:06.989006 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c53a1849-e8f0-4e3b-8b7f-7b5dfa5672b2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-444913412", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-121267945", "security_groups": [{"name": "tempest-secgroup-smoke-630239606"}], "block_device_mapping_v2": [{"uuid": "7e7c75e1-565d-4fd1-9c25-f903ad87aa28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "baf48a70-9fcf-4c95-9a4f-c0f2d3f641eb"}]}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:56:06.998769 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=15 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:56:06.999482 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=97 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:56:07.151506 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.network.neutron [None req-c53a1849-e8f0-4e3b-8b7f-7b5dfa5672b2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] validate_networks() for [('baf48a70-9fcf-4c95-9a4f-c0f2d3f641eb', None, None, None, None, None)] {{(pid=129472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:56:07.633039 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-c53a1849-e8f0-4e3b-8b7f-7b5dfa5672b2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Flavor limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:56:07.633480 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-c53a1849-e8f0-4e3b-8b7f-7b5dfa5672b2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Image limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:56:07.633993 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-c53a1849-e8f0-4e3b-8b7f-7b5dfa5672b2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Flavor pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:56:07.634429 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-c53a1849-e8f0-4e3b-8b7f-7b5dfa5672b2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Image pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:56:07.634842 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-c53a1849-e8f0-4e3b-8b7f-7b5dfa5672b2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:56:07.646022 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c53a1849-e8f0-4e3b-8b7f-7b5dfa5672b2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:07.646533 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c53a1849-e8f0-4e3b-8b7f-7b5dfa5672b2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:07.647494 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c53a1849-e8f0-4e3b-8b7f-7b5dfa5672b2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:07.647992 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c53a1849-e8f0-4e3b-8b7f-7b5dfa5672b2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:07.668222 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-c53a1849-e8f0-4e3b-8b7f-7b5dfa5672b2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Getting quotas for project ec9f767e3b4d4fb78f86a611ed9f47c5. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:56:07.673039 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-c53a1849-e8f0-4e3b-8b7f-7b5dfa5672b2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Getting quotas for user 25024a505319480ab00f4c7e58de600c and project ec9f767e3b4d4fb78f86a611ed9f47c5. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:56:07.743156 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c53a1849-e8f0-4e3b-8b7f-7b5dfa5672b2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Going to run 1 instances... {{(pid=129472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:56:07.745357 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c53a1849-e8f0-4e3b-8b7f-7b5dfa5672b2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7e7c75e1-565d-4fd1-9c25-f903ad87aa28',volume_size=None,volume_type=None)] {{(pid=129472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:56:07.915474 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c53a1849-e8f0-4e3b-8b7f-7b5dfa5672b2 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.930662 Jun 27 15:56:07.916143 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 465/938] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 15:56:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:56:07.931333 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-9827ead9-4bac-4b5a-998f-4107dbb932db tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:07.932443 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-9827ead9-4bac-4b5a-998f-4107dbb932db tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:07.936935 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:56:07.938193 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=83 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:56:08.035287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-9827ead9-4bac-4b5a-998f-4107dbb932db tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:08.049761 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-9827ead9-4bac-4b5a-998f-4107dbb932db tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1093 microversion: 2.1 time: 0.126086 Jun 27 15:56:08.050774 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 474/939] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:07 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1093 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:09.068842 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8a3d77f4-903a-4fb8-9bf4-01ec831d85e3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:09.069914 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8a3d77f4-903a-4fb8-9bf4-01ec831d85e3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:09.082862 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8a3d77f4-903a-4fb8-9bf4-01ec831d85e3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:09.085606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8a3d77f4-903a-4fb8-9bf4-01ec831d85e3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:09.087094 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8a3d77f4-903a-4fb8-9bf4-01ec831d85e3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:09.087881 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8a3d77f4-903a-4fb8-9bf4-01ec831d85e3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:09.161943 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8a3d77f4-903a-4fb8-9bf4-01ec831d85e3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:09.171425 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-8a3d77f4-903a-4fb8-9bf4-01ec831d85e3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1191 microversion: 2.1 time: 0.107884 Jun 27 15:56:09.172018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 466/940] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:09 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1191 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:10.193595 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d4223939-f66c-41d0-961e-e5190f26bedd tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:10.195458 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d4223939-f66c-41d0-961e-e5190f26bedd tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:10.206157 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d4223939-f66c-41d0-961e-e5190f26bedd tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:10.206993 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d4223939-f66c-41d0-961e-e5190f26bedd tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:10.208617 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d4223939-f66c-41d0-961e-e5190f26bedd tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:10.210138 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d4223939-f66c-41d0-961e-e5190f26bedd tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:10.351989 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d4223939-f66c-41d0-961e-e5190f26bedd tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:10.371993 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d4223939-f66c-41d0-961e-e5190f26bedd tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1209 microversion: 2.1 time: 0.184485 Jun 27 15:56:10.386447 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 475/941] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:10 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1209 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:11.404860 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-02545d82-3e1e-45ac-a676-394156a27ad4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:11.407042 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-02545d82-3e1e-45ac-a676-394156a27ad4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:11.417901 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-02545d82-3e1e-45ac-a676-394156a27ad4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:11.418820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-02545d82-3e1e-45ac-a676-394156a27ad4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:11.420996 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-02545d82-3e1e-45ac-a676-394156a27ad4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:11.422013 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-02545d82-3e1e-45ac-a676-394156a27ad4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:11.701059 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-02545d82-3e1e-45ac-a676-394156a27ad4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:11.719586 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-02545d82-3e1e-45ac-a676-394156a27ad4 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1264 microversion: 2.1 time: 0.322955 Jun 27 15:56:11.723720 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 467/942] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:11 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1264 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:11.991559 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-9e914db1-2917-4cb5-92ce-f18f5781f4a1 req-5c6e49ba-9a43-4ed3-b61a-1c966e71a696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64ee8b86-556e-4dc8-bff9-3b5c99f14056", "tag": "516f1166-861f-48fb-965b-e8b29530c5d9"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:56:12.046724 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-9e914db1-2917-4cb5-92ce-f18f5781f4a1 req-5c6e49ba-9a43-4ed3-b61a-1c966e71a696 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:12.048044 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-9e914db1-2917-4cb5-92ce-f18f5781f4a1 req-5c6e49ba-9a43-4ed3-b61a-1c966e71a696 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:12.077700 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-9e914db1-2917-4cb5-92ce-f18f5781f4a1 req-5c6e49ba-9a43-4ed3-b61a-1c966e71a696 service nova] Creating event network-changed:516f1166-861f-48fb-965b-e8b29530c5d9 for instance 64ee8b86-556e-4dc8-bff9-3b5c99f14056 on hv-cinder-84780 Jun 27 15:56:12.094188 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-9e914db1-2917-4cb5-92ce-f18f5781f4a1 req-5c6e49ba-9a43-4ed3-b61a-1c966e71a696 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118267 Jun 27 15:56:12.097188 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 476/943] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:56:12.748875 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-10d23104-3812-4ee6-83f1-bd63a8f7a8c3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:12.749805 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-10d23104-3812-4ee6-83f1-bd63a8f7a8c3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:12.757388 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-10d23104-3812-4ee6-83f1-bd63a8f7a8c3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:12.758442 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-10d23104-3812-4ee6-83f1-bd63a8f7a8c3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:12.759250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-10d23104-3812-4ee6-83f1-bd63a8f7a8c3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:12.759908 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-10d23104-3812-4ee6-83f1-bd63a8f7a8c3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:12.937785 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-10d23104-3812-4ee6-83f1-bd63a8f7a8c3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:12.948673 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-10d23104-3812-4ee6-83f1-bd63a8f7a8c3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1264 microversion: 2.1 time: 0.204247 Jun 27 15:56:12.949919 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 468/944] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:12 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1264 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:56:13.975604 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-bd20f876-5a6f-4856-b2af-e8c02da12ab9 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:13.976222 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-bd20f876-5a6f-4856-b2af-e8c02da12ab9 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:13.983365 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bd20f876-5a6f-4856-b2af-e8c02da12ab9 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:13.983870 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bd20f876-5a6f-4856-b2af-e8c02da12ab9 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:13.984751 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bd20f876-5a6f-4856-b2af-e8c02da12ab9 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:13.985242 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bd20f876-5a6f-4856-b2af-e8c02da12ab9 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:14.193176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-bd20f876-5a6f-4856-b2af-e8c02da12ab9 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:14.203725 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-bd20f876-5a6f-4856-b2af-e8c02da12ab9 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1264 microversion: 2.1 time: 0.234055 Jun 27 15:56:14.204424 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 477/945] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:13 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:15.228198 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-cdef4b02-ae5e-4801-9dde-914b59afa5e9 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:15.228803 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-cdef4b02-ae5e-4801-9dde-914b59afa5e9 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:15.236204 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cdef4b02-ae5e-4801-9dde-914b59afa5e9 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:15.236648 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cdef4b02-ae5e-4801-9dde-914b59afa5e9 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:15.237430 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cdef4b02-ae5e-4801-9dde-914b59afa5e9 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:15.237901 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cdef4b02-ae5e-4801-9dde-914b59afa5e9 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:15.387554 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-cdef4b02-ae5e-4801-9dde-914b59afa5e9 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:15.395798 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-cdef4b02-ae5e-4801-9dde-914b59afa5e9 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1264 microversion: 2.1 time: 0.172519 Jun 27 15:56:15.396391 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 469/946] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:15 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:16.420068 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-362c2d9d-8966-4c30-b829-307d8ffa41e1 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:16.421091 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-362c2d9d-8966-4c30-b829-307d8ffa41e1 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:16.429210 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-362c2d9d-8966-4c30-b829-307d8ffa41e1 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:16.429908 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-362c2d9d-8966-4c30-b829-307d8ffa41e1 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:16.430726 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-362c2d9d-8966-4c30-b829-307d8ffa41e1 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:16.431170 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-362c2d9d-8966-4c30-b829-307d8ffa41e1 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:16.593575 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-362c2d9d-8966-4c30-b829-307d8ffa41e1 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:16.606766 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-362c2d9d-8966-4c30-b829-307d8ffa41e1 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1264 microversion: 2.1 time: 0.190571 Jun 27 15:56:16.607899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 478/947] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:16 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:17.627473 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-bcc33555-d67a-4b25-994c-75e858c2b8a3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:17.628222 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-bcc33555-d67a-4b25-994c-75e858c2b8a3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:17.637170 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bcc33555-d67a-4b25-994c-75e858c2b8a3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:17.637657 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bcc33555-d67a-4b25-994c-75e858c2b8a3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:17.638457 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bcc33555-d67a-4b25-994c-75e858c2b8a3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:17.638899 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bcc33555-d67a-4b25-994c-75e858c2b8a3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:17.662751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=2 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:56:17.685356 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=6 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:56:17.835780 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-bcc33555-d67a-4b25-994c-75e858c2b8a3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:17.849536 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-bcc33555-d67a-4b25-994c-75e858c2b8a3 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1264 microversion: 2.1 time: 0.225734 Jun 27 15:56:17.851124 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 470/948] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:17 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:18.877318 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c52446f1-38a1-4973-b163-2bd85c140020 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:18.878137 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c52446f1-38a1-4973-b163-2bd85c140020 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:18.882836 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=2 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:56:18.890281 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c52446f1-38a1-4973-b163-2bd85c140020 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:18.890811 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c52446f1-38a1-4973-b163-2bd85c140020 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:18.891675 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c52446f1-38a1-4973-b163-2bd85c140020 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:18.892150 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c52446f1-38a1-4973-b163-2bd85c140020 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:19.089996 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-c52446f1-38a1-4973-b163-2bd85c140020 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:19.099180 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c52446f1-38a1-4973-b163-2bd85c140020 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1264 microversion: 2.1 time: 0.226328 Jun 27 15:56:19.100267 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 479/949] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:18 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:20.118301 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-06271767-79f3-4475-9e49-d9db9de45dfe tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:20.119026 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-06271767-79f3-4475-9e49-d9db9de45dfe tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:20.126196 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-06271767-79f3-4475-9e49-d9db9de45dfe tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:20.126640 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-06271767-79f3-4475-9e49-d9db9de45dfe tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:20.127436 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-06271767-79f3-4475-9e49-d9db9de45dfe tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:20.127891 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-06271767-79f3-4475-9e49-d9db9de45dfe tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:20.349550 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-06271767-79f3-4475-9e49-d9db9de45dfe tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:20.358035 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-06271767-79f3-4475-9e49-d9db9de45dfe tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1264 microversion: 2.1 time: 0.244724 Jun 27 15:56:20.358734 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 471/950] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:20 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1264 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:21.375631 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f3e01af6-3c84-4dbd-8609-fc8b9f1f55cc tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:21.376321 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f3e01af6-3c84-4dbd-8609-fc8b9f1f55cc tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:21.384813 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f3e01af6-3c84-4dbd-8609-fc8b9f1f55cc tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:21.385298 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f3e01af6-3c84-4dbd-8609-fc8b9f1f55cc tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:21.386141 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f3e01af6-3c84-4dbd-8609-fc8b9f1f55cc tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:21.386581 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f3e01af6-3c84-4dbd-8609-fc8b9f1f55cc tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:21.607386 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f3e01af6-3c84-4dbd-8609-fc8b9f1f55cc tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:21.616007 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f3e01af6-3c84-4dbd-8609-fc8b9f1f55cc tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1264 microversion: 2.1 time: 0.244205 Jun 27 15:56:21.616617 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 480/951] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:21 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1264 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:22.634389 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-654a292c-eb6a-4670-9542-ac8468b5da5c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:22.635457 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-654a292c-eb6a-4670-9542-ac8468b5da5c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:22.645178 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-654a292c-eb6a-4670-9542-ac8468b5da5c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:22.646040 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-654a292c-eb6a-4670-9542-ac8468b5da5c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:22.647993 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-654a292c-eb6a-4670-9542-ac8468b5da5c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:22.648755 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-654a292c-eb6a-4670-9542-ac8468b5da5c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:22.847840 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-654a292c-eb6a-4670-9542-ac8468b5da5c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:22.862074 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-654a292c-eb6a-4670-9542-ac8468b5da5c tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1264 microversion: 2.1 time: 0.232167 Jun 27 15:56:22.863173 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 472/952] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:22 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1264 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:23.894706 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b9767706-a428-4361-a085-60b69761db47 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:23.895351 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b9767706-a428-4361-a085-60b69761db47 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:23.903040 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b9767706-a428-4361-a085-60b69761db47 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:23.903496 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b9767706-a428-4361-a085-60b69761db47 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:23.904291 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b9767706-a428-4361-a085-60b69761db47 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:23.904734 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b9767706-a428-4361-a085-60b69761db47 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:24.065865 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b9767706-a428-4361-a085-60b69761db47 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:24.076859 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b9767706-a428-4361-a085-60b69761db47 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1264 microversion: 2.1 time: 0.186127 Jun 27 15:56:24.077692 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 481/953] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:23 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:56:24.234887 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-114415f1-a6a0-47c2-95f6-049246bfd8b2 req-dd49606f-d953-4df7-9ada-4c982cebf647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64ee8b86-556e-4dc8-bff9-3b5c99f14056", "name": "network-vif-plugged", "status": "completed", "tag": "516f1166-861f-48fb-965b-e8b29530c5d9"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:56:24.247398 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-114415f1-a6a0-47c2-95f6-049246bfd8b2 req-dd49606f-d953-4df7-9ada-4c982cebf647 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:24.248247 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-114415f1-a6a0-47c2-95f6-049246bfd8b2 req-dd49606f-d953-4df7-9ada-4c982cebf647 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:24.263607 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-114415f1-a6a0-47c2-95f6-049246bfd8b2 req-dd49606f-d953-4df7-9ada-4c982cebf647 service nova] Creating event network-vif-plugged:516f1166-861f-48fb-965b-e8b29530c5d9 for instance 64ee8b86-556e-4dc8-bff9-3b5c99f14056 on hv-cinder-84780 Jun 27 15:56:24.271903 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-114415f1-a6a0-47c2-95f6-049246bfd8b2 req-dd49606f-d953-4df7-9ada-4c982cebf647 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041084 Jun 27 15:56:24.273324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 473/954] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:56:25.100898 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0b099398-a453-46a5-9f4e-0ab4bbdf9d6a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:25.101649 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-0b099398-a453-46a5-9f4e-0ab4bbdf9d6a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:25.109079 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0b099398-a453-46a5-9f4e-0ab4bbdf9d6a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:25.109528 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0b099398-a453-46a5-9f4e-0ab4bbdf9d6a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:25.110358 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0b099398-a453-46a5-9f4e-0ab4bbdf9d6a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:25.110802 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-0b099398-a453-46a5-9f4e-0ab4bbdf9d6a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:25.265018 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-0b099398-a453-46a5-9f4e-0ab4bbdf9d6a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:25.273752 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-0b099398-a453-46a5-9f4e-0ab4bbdf9d6a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1264 microversion: 2.1 time: 0.177471 Jun 27 15:56:25.274352 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 482/955] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:25 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:26.293678 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a3c82393-4da4-47a0-bb7a-70316ec35258 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:26.294788 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a3c82393-4da4-47a0-bb7a-70316ec35258 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:26.302204 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a3c82393-4da4-47a0-bb7a-70316ec35258 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:26.303158 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a3c82393-4da4-47a0-bb7a-70316ec35258 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:26.303952 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a3c82393-4da4-47a0-bb7a-70316ec35258 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:26.304390 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a3c82393-4da4-47a0-bb7a-70316ec35258 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:26.495643 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-a3c82393-4da4-47a0-bb7a-70316ec35258 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:26.503824 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-a3c82393-4da4-47a0-bb7a-70316ec35258 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1264 microversion: 2.1 time: 0.214951 Jun 27 15:56:26.504419 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 474/956] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:26 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1264 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:56:27.523145 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-9765bcf0-f035-44a3-b601-16d0a5d4d074 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:27.523760 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-9765bcf0-f035-44a3-b601-16d0a5d4d074 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:27.530995 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9765bcf0-f035-44a3-b601-16d0a5d4d074 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:27.531471 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9765bcf0-f035-44a3-b601-16d0a5d4d074 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:27.532260 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9765bcf0-f035-44a3-b601-16d0a5d4d074 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:27.532686 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9765bcf0-f035-44a3-b601-16d0a5d4d074 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:27.732671 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-9765bcf0-f035-44a3-b601-16d0a5d4d074 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:27.742988 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-9765bcf0-f035-44a3-b601-16d0a5d4d074 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1450 microversion: 2.1 time: 0.223997 Jun 27 15:56:27.743602 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 483/957] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:27 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1450 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:56:27.767773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-cc4a6a9e-6b72-4eca-b634-2c9f2fe984db tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:27.768525 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-cc4a6a9e-6b72-4eca-b634-2c9f2fe984db tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:27.776355 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cc4a6a9e-6b72-4eca-b634-2c9f2fe984db tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:27.776723 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cc4a6a9e-6b72-4eca-b634-2c9f2fe984db tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:27.777680 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cc4a6a9e-6b72-4eca-b634-2c9f2fe984db tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:27.778122 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cc4a6a9e-6b72-4eca-b634-2c9f2fe984db tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:27.954126 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-cc4a6a9e-6b72-4eca-b634-2c9f2fe984db tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:27.963181 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-cc4a6a9e-6b72-4eca-b634-2c9f2fe984db tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1450 microversion: 2.1 time: 0.199520 Jun 27 15:56:27.963800 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 475/958] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:27 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1450 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:30.085316 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-5e8899ea-29f3-4028-806d-028f293a22e0 req-805044bb-f0ed-4759-bb5c-b833d3ff683a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64ee8b86-556e-4dc8-bff9-3b5c99f14056", "tag": "516f1166-861f-48fb-965b-e8b29530c5d9"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:56:30.095794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-5e8899ea-29f3-4028-806d-028f293a22e0 req-805044bb-f0ed-4759-bb5c-b833d3ff683a service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:30.096616 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-5e8899ea-29f3-4028-806d-028f293a22e0 req-805044bb-f0ed-4759-bb5c-b833d3ff683a service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:30.113687 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-5e8899ea-29f3-4028-806d-028f293a22e0 req-805044bb-f0ed-4759-bb5c-b833d3ff683a service nova] Creating event network-changed:516f1166-861f-48fb-965b-e8b29530c5d9 for instance 64ee8b86-556e-4dc8-bff9-3b5c99f14056 on hv-cinder-84780 Jun 27 15:56:30.120320 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-5e8899ea-29f3-4028-806d-028f293a22e0 req-805044bb-f0ed-4759-bb5c-b833d3ff683a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040215 Jun 27 15:56:30.121341 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 484/959] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:56:35.863579 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-5e8a1407-6fe7-4f26-b596-9105a0bd57e9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:35.864594 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-5e8a1407-6fe7-4f26-b596-9105a0bd57e9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:35.872929 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5e8a1407-6fe7-4f26-b596-9105a0bd57e9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:35.873463 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5e8a1407-6fe7-4f26-b596-9105a0bd57e9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:35.874324 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5e8a1407-6fe7-4f26-b596-9105a0bd57e9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:35.874802 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5e8a1407-6fe7-4f26-b596-9105a0bd57e9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:35.909695 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-5e8a1407-6fe7-4f26-b596-9105a0bd57e9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052261 Jun 27 15:56:35.910268 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 476/960] 10.222.0.20 () {60 vars in 1342 bytes} [Mon Jun 27 15:56:35 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:35.979302 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d10d7215-f9b3-4ab0-a1cb-3a4343eb0c10 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:35.980059 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d10d7215-f9b3-4ab0-a1cb-3a4343eb0c10 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:35.990930 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d10d7215-f9b3-4ab0-a1cb-3a4343eb0c10 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:35.991535 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d10d7215-f9b3-4ab0-a1cb-3a4343eb0c10 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:35.992455 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d10d7215-f9b3-4ab0-a1cb-3a4343eb0c10 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:35.992899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d10d7215-f9b3-4ab0-a1cb-3a4343eb0c10 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:36.022782 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d10d7215-f9b3-4ab0-a1cb-3a4343eb0c10 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Going to try to terminate instance {{(pid=129473) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:56:36.076690 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-08aab7b7-f875-4c16-9303-4b0f2f692fb0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:36.077403 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-08aab7b7-f875-4c16-9303-4b0f2f692fb0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:36.085418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-08aab7b7-f875-4c16-9303-4b0f2f692fb0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:36.086209 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-08aab7b7-f875-4c16-9303-4b0f2f692fb0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:36.087103 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-08aab7b7-f875-4c16-9303-4b0f2f692fb0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:36.087695 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-08aab7b7-f875-4c16-9303-4b0f2f692fb0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:36.114254 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-08aab7b7-f875-4c16-9303-4b0f2f692fb0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e/ips" status: 200 len: 149 microversion: 2.1 time: 0.043308 Jun 27 15:56:36.115237 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 477/961] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 27 15:56:36 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:56:36.133015 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d10d7215-f9b3-4ab0-a1cb-3a4343eb0c10 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "DELETE /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 204 len: 0 microversion: 2.20 time: 0.156223 Jun 27 15:56:36.134048 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d7d08e95-64ec-4e84-b903-1b55a85da6ca tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5afd6fa8-456c-4679-8ae1-a748709bfbce"}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:56:36.134479 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 485/962] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Jun 27 15:56:35 2022] DELETE /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 27 15:56:36.135932 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d7d08e95-64ec-4e84-b903-1b55a85da6ca tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:36.144890 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-2486e5bf-ef48-471a-b22b-9caf85593c40 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:36.145594 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-2486e5bf-ef48-471a-b22b-9caf85593c40 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:36.147042 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d7d08e95-64ec-4e84-b903-1b55a85da6ca tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:36.147823 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d7d08e95-64ec-4e84-b903-1b55a85da6ca tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:36.149185 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d7d08e95-64ec-4e84-b903-1b55a85da6ca tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:36.149954 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d7d08e95-64ec-4e84-b903-1b55a85da6ca tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:36.152146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2486e5bf-ef48-471a-b22b-9caf85593c40 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:36.152607 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2486e5bf-ef48-471a-b22b-9caf85593c40 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:36.153407 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2486e5bf-ef48-471a-b22b-9caf85593c40 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:36.153904 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2486e5bf-ef48-471a-b22b-9caf85593c40 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:36.280176 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-d7d08e95-64ec-4e84-b903-1b55a85da6ca tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] HTTP exception thrown: Invalid volume: volume 5afd6fa8-456c-4679-8ae1-a748709bfbce is already attached to instances: f74d93df-6aac-45ba-83a0-4bafe2c375aa Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d7d08e95-64ec-4e84-b903-1b55a85da6ca tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Request method failure captured: Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: POST /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e/os-volume_attachments HTTP/1.1 Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 74 Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudKgwhUwXfk48AzZs0c5fmwwnDHGCcKPSCxkN5S5OSVIy6LsaEhk8pkOYw3Gba3WVv-Fl8yJFTEFhTCQMs2rJ8pHCHlMqrvqMWGswWTUzgomFdKB0h_BYFAabKkpg_N6pl3W9_BhGboKe81vFI9AcJFLfEjyn2HlzbkDBAwN4ZsQghM Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:56:36.283776 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:56:36.286559 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_90d9fb4d2e024e6eac7eeee72e63e904", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:56:36.286559 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:56:36.286559 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:56:36.286559 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:56:36.286559 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:56:36.286559 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:56:36.286559 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:56:36.286559 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: ce59e0072f1c4b91a2825e5fecde7e23 Jun 27 15:56:36.286559 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:56:36.286559 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Jun 27 15:56:36.286559 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {"volumeAttachment": {"volumeId": "5afd6fa8-456c-4679-8ae1-a748709bfbce"}} Jun 27 15:56:36.286559 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:56:36.288250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Invalid volume: volume 5afd6fa8-456c-4679-8ae1-a748709bfbce is already attached to instances: f74d93df-6aac-45ba-83a0-4bafe2c375aa Jun 27 15:56:36.288250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'server_id': '8f94baae-848b-491b-ba4e-56149f83856e', 'body': {'volumeAttachment': {'volumeId': '5afd6fa8-456c-4679-8ae1-a748709bfbce'}}} Jun 27 15:56:36.288250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:56:36.288250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:36.288250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 15:56:36.288250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 15:56:36.288250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 15:56:36.288250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 15:56:36.288250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 27 15:56:36.288250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 27 15:56:36.288250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 27 15:56:36.288250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 27 15:56:36.288250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 27 15:56:36.288250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 27 15:56:36.288250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5afd6fa8-456c-4679-8ae1-a748709bfbce is already attached to instances: f74d93df-6aac-45ba-83a0-4bafe2c375aa Jun 27 15:56:36.288250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:36.288250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:36.288250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:36.288250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5afd6fa8-456c-4679-8ae1-a748709bfbce is already attached to instances: f74d93df-6aac-45ba-83a0-4bafe2c375aa Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:36.290744 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:36.296341 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:36.296341 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:56:36.296341 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:56:36.296341 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5afd6fa8-456c-4679-8ae1-a748709bfbce is already attached to instances: f74d93df-6aac-45ba-83a0-4bafe2c375aa Jun 27 15:56:36.296341 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:36.296341 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d7d08e95-64ec-4e84-b903-1b55a85da6ca tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Returning 400 to user: Invalid volume: volume 5afd6fa8-456c-4679-8ae1-a748709bfbce is already attached to instances: f74d93df-6aac-45ba-83a0-4bafe2c375aa {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:56:36.296341 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d7d08e95-64ec-4e84-b903-1b55a85da6ca tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "POST /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.160820 Jun 27 15:56:36.296341 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 478/963] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 27 15:56:36 2022] POST /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e/os-volume_attachments => generated 174 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:56:36.297701 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-4822233f-7599-4f76-821b-3efae2e3cd21 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:36.298264 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-4822233f-7599-4f76-821b-3efae2e3cd21 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:36.308750 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4822233f-7599-4f76-821b-3efae2e3cd21 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:36.309211 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4822233f-7599-4f76-821b-3efae2e3cd21 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:36.310076 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4822233f-7599-4f76-821b-3efae2e3cd21 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:36.310519 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4822233f-7599-4f76-821b-3efae2e3cd21 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:36.338562 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2486e5bf-ef48-471a-b22b-9caf85593c40 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:36.341673 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-4822233f-7599-4f76-821b-3efae2e3cd21 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Going to try to terminate instance {{(pid=129472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:56:36.354778 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2486e5bf-ef48-471a-b22b-9caf85593c40 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:36.358301 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2486e5bf-ef48-471a-b22b-9caf85593c40 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:36.360521 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-2486e5bf-ef48-471a-b22b-9caf85593c40 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.220335 Jun 27 15:56:36.362501 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 486/964] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:56:36 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:56:36.438605 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-4822233f-7599-4f76-821b-3efae2e3cd21 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 204 len: 0 microversion: 2.1 time: 0.146220 Jun 27 15:56:36.439205 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 479/965] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:56:36 2022] DELETE /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:56:36.453898 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-fa1beddd-f01d-47d6-895d-96ecbdc543e3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:36.454913 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-fa1beddd-f01d-47d6-895d-96ecbdc543e3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:36.463182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fa1beddd-f01d-47d6-895d-96ecbdc543e3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:36.463636 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fa1beddd-f01d-47d6-895d-96ecbdc543e3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:36.464437 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fa1beddd-f01d-47d6-895d-96ecbdc543e3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:36.464876 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fa1beddd-f01d-47d6-895d-96ecbdc543e3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:36.637192 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-fa1beddd-f01d-47d6-895d-96ecbdc543e3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:36.645438 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-fa1beddd-f01d-47d6-895d-96ecbdc543e3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1681 microversion: 2.1 time: 0.198659 Jun 27 15:56:36.646111 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 487/966] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:36 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1681 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:37.385490 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ff9b9c4c-c334-494e-97a0-0351c0aa20d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:37.386777 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-ff9b9c4c-c334-494e-97a0-0351c0aa20d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:37.389779 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:56:37.399329 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ff9b9c4c-c334-494e-97a0-0351c0aa20d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:37.400023 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ff9b9c4c-c334-494e-97a0-0351c0aa20d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:37.400932 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ff9b9c4c-c334-494e-97a0-0351c0aa20d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:37.401488 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ff9b9c4c-c334-494e-97a0-0351c0aa20d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:37.405892 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:56:37.624923 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ff9b9c4c-c334-494e-97a0-0351c0aa20d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:37.640632 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ff9b9c4c-c334-494e-97a0-0351c0aa20d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:37.643669 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ff9b9c4c-c334-494e-97a0-0351c0aa20d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:37.646535 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ff9b9c4c-c334-494e-97a0-0351c0aa20d4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.266956 Jun 27 15:56:37.647916 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 480/967] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:56:37 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:56:37.669884 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-96bd6afa-e57c-41b0-a50e-430914b9cd25 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:37.671266 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-96bd6afa-e57c-41b0-a50e-430914b9cd25 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:37.683269 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-96bd6afa-e57c-41b0-a50e-430914b9cd25 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:37.684047 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-96bd6afa-e57c-41b0-a50e-430914b9cd25 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:37.685297 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-96bd6afa-e57c-41b0-a50e-430914b9cd25 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:37.686032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-96bd6afa-e57c-41b0-a50e-430914b9cd25 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:37.905980 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-96bd6afa-e57c-41b0-a50e-430914b9cd25 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:37.916192 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-96bd6afa-e57c-41b0-a50e-430914b9cd25 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1681 microversion: 2.1 time: 0.254456 Jun 27 15:56:37.916999 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 488/968] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:37 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1681 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:38.671131 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-6f7741f6-5870-4637-8a75-a31d2c44f9b4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:38.672285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-6f7741f6-5870-4637-8a75-a31d2c44f9b4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:38.685926 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6f7741f6-5870-4637-8a75-a31d2c44f9b4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:38.686769 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6f7741f6-5870-4637-8a75-a31d2c44f9b4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:38.688220 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6f7741f6-5870-4637-8a75-a31d2c44f9b4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:38.689111 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6f7741f6-5870-4637-8a75-a31d2c44f9b4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:38.876904 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-6f7741f6-5870-4637-8a75-a31d2c44f9b4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:38.887363 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-6f7741f6-5870-4637-8a75-a31d2c44f9b4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:38.889086 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-6f7741f6-5870-4637-8a75-a31d2c44f9b4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:38.890928 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-6f7741f6-5870-4637-8a75-a31d2c44f9b4 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.227799 Jun 27 15:56:38.891688 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 481/969] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:56:38 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:56:38.936928 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e50da0d0-e16d-493a-b9e1-1bd468646201 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:38.937899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e50da0d0-e16d-493a-b9e1-1bd468646201 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:38.941375 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:56:38.950322 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e50da0d0-e16d-493a-b9e1-1bd468646201 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:38.950887 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e50da0d0-e16d-493a-b9e1-1bd468646201 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:38.951756 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e50da0d0-e16d-493a-b9e1-1bd468646201 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:38.952292 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e50da0d0-e16d-493a-b9e1-1bd468646201 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:38.955742 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:56:39.174057 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e50da0d0-e16d-493a-b9e1-1bd468646201 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:39.184043 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e50da0d0-e16d-493a-b9e1-1bd468646201 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1681 microversion: 2.1 time: 0.251193 Jun 27 15:56:39.184828 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 489/970] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:38 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1681 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:39.924499 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-705b5d51-fd92-4ee3-9b19-a94a0770c7eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:39.925889 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-705b5d51-fd92-4ee3-9b19-a94a0770c7eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:39.938494 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-705b5d51-fd92-4ee3-9b19-a94a0770c7eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:39.939326 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-705b5d51-fd92-4ee3-9b19-a94a0770c7eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:39.940608 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-705b5d51-fd92-4ee3-9b19-a94a0770c7eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:39.941341 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-705b5d51-fd92-4ee3-9b19-a94a0770c7eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:40.145345 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-705b5d51-fd92-4ee3-9b19-a94a0770c7eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:40.156342 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-705b5d51-fd92-4ee3-9b19-a94a0770c7eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:40.158137 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-705b5d51-fd92-4ee3-9b19-a94a0770c7eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:40.159541 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-705b5d51-fd92-4ee3-9b19-a94a0770c7eb tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1724 microversion: 2.20 time: 0.242511 Jun 27 15:56:40.160717 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 482/971] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:56:39 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:56:40.213342 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-fd1e1189-0466-4f42-8355-6eb60653df67 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:40.214397 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-fd1e1189-0466-4f42-8355-6eb60653df67 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:40.223145 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fd1e1189-0466-4f42-8355-6eb60653df67 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:40.223770 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fd1e1189-0466-4f42-8355-6eb60653df67 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:40.224810 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fd1e1189-0466-4f42-8355-6eb60653df67 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:40.225449 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fd1e1189-0466-4f42-8355-6eb60653df67 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:40.419388 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-fd1e1189-0466-4f42-8355-6eb60653df67 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:40.431374 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-fd1e1189-0466-4f42-8355-6eb60653df67 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1681 microversion: 2.1 time: 0.224004 Jun 27 15:56:40.432538 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 490/972] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:40 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1681 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:56:41.192451 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-66a57386-4ae4-4768-b9dd-e09e2905647c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:41.195235 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-66a57386-4ae4-4768-b9dd-e09e2905647c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:41.212197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-66a57386-4ae4-4768-b9dd-e09e2905647c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:41.213558 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-66a57386-4ae4-4768-b9dd-e09e2905647c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:41.215800 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-66a57386-4ae4-4768-b9dd-e09e2905647c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:41.217040 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-66a57386-4ae4-4768-b9dd-e09e2905647c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:41.296256 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-a7267a01-1d30-4c5e-9abe-b58311128edd req-e5836194-ade5-4479-a611-c44b01d9730d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a5fc50-738a-4228-9733-e9e7b34daccd", "name": "network-vif-deleted", "tag": "c7c3302d-ee51-4be2-b345-2ab41cfc76b0"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:56:41.340990 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-a7267a01-1d30-4c5e-9abe-b58311128edd req-e5836194-ade5-4479-a611-c44b01d9730d service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:41.341724 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-a7267a01-1d30-4c5e-9abe-b58311128edd req-e5836194-ade5-4479-a611-c44b01d9730d service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:41.375802 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-a7267a01-1d30-4c5e-9abe-b58311128edd req-e5836194-ade5-4479-a611-c44b01d9730d service nova] Creating event network-vif-deleted:c7c3302d-ee51-4be2-b345-2ab41cfc76b0 for instance 32a5fc50-738a-4228-9733-e9e7b34daccd on hv-cinder-84780 Jun 27 15:56:41.388495 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-a7267a01-1d30-4c5e-9abe-b58311128edd req-e5836194-ade5-4479-a611-c44b01d9730d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103907 Jun 27 15:56:41.390885 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 491/973] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:56:41.464775 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-6b470699-c52e-44a1-bcda-228fcda190af tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:41.466158 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-6b470699-c52e-44a1-bcda-228fcda190af tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:41.493226 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-66a57386-4ae4-4768-b9dd-e09e2905647c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:41.511907 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6b470699-c52e-44a1-bcda-228fcda190af tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:41.514958 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6b470699-c52e-44a1-bcda-228fcda190af tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:41.520224 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6b470699-c52e-44a1-bcda-228fcda190af tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:41.523089 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6b470699-c52e-44a1-bcda-228fcda190af tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:41.535310 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-66a57386-4ae4-4768-b9dd-e09e2905647c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:41.547792 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-66a57386-4ae4-4768-b9dd-e09e2905647c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6890639a0a2e4ca9b103919fdbbffc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d416620e9f942ab9f76e6b117cd8b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:41.556238 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-66a57386-4ae4-4768-b9dd-e09e2905647c tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 200 len: 1657 microversion: 2.20 time: 0.374856 Jun 27 15:56:41.558743 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 483/974] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:56:41 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 1657 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:56:41.700442 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-6b470699-c52e-44a1-bcda-228fcda190af tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:41.715442 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-6b470699-c52e-44a1-bcda-228fcda190af tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 200 len: 1326 microversion: 2.1 time: 0.260177 Jun 27 15:56:41.721803 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 492/975] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:41 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 1326 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:42.592249 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8b6b2842-3eac-4f08-8bf6-f1bdcd98eace tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:42.593505 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8b6b2842-3eac-4f08-8bf6-f1bdcd98eace tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:42.603021 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8b6b2842-3eac-4f08-8bf6-f1bdcd98eace tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:42.604076 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8b6b2842-3eac-4f08-8bf6-f1bdcd98eace tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:42.604607 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8b6b2842-3eac-4f08-8bf6-f1bdcd98eace tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:42.605161 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8b6b2842-3eac-4f08-8bf6-f1bdcd98eace tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:42.625208 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-8b6b2842-3eac-4f08-8bf6-f1bdcd98eace tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] HTTP exception thrown: Instance 32a5fc50-738a-4228-9733-e9e7b34daccd could not be found. Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8b6b2842-3eac-4f08-8bf6-f1bdcd98eace tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Request method failure captured: Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd HTTP/1.1 Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudGT-29gJSaPG9yRbV3WCZW3eyz3_EztkPHwj0NbSTDMnF3G40kk8EaUr0pRdqYXBttyn45sIxL7Ex__hCs-mfI1OPIB7VGEnk3L-o3lbUuJSbudzww_VDODiLxWXJ_o-hW1Yfl1t0k-uPvmiKu11boP05BbWdlDOLlHyqn4vFO831U Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 5d416620e9f942ab9f76e6b117cd8b61 Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-614482775 Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:56:42.626975 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:56:42.631603 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d416620e9f942ab9f76e6b117cd8b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d416620e9f942ab9f76e6b117cd8b61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d416620e9f942ab9f76e6b117cd8b61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d416620e9f942ab9f76e6b117cd8b61", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:56:42.631603 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-AttachVolumeShelveTestJSON-614482775 Jun 27 15:56:42.631603 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 5d416620e9f942ab9f76e6b117cd8b61 Jun 27 15:56:42.631603 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-614482775 Jun 27 15:56:42.631603 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-AttachVolumeShelveTestJSON-614482775-project Jun 27 15:56:42.631603 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:56:42.631603 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:56:42.631603 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: 6890639a0a2e4ca9b103919fdbbffc5b Jun 27 15:56:42.631603 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-AttachVolumeShelveTestJSON-614482775-project Jun 27 15:56:42.631603 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:56:42.631603 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance 32a5fc50-738a-4228-9733-e9e7b34daccd could not be found. Jun 27 15:56:42.631603 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': '32a5fc50-738a-4228-9733-e9e7b34daccd'} Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a5fc50-738a-4228-9733-e9e7b34daccd could not be found. Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:56:42.633392 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:56:42.636236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:56:42.636236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:56:42.636236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:56:42.636236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:56:42.636236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:56:42.636236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:56:42.636236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:56:42.636236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a5fc50-738a-4228-9733-e9e7b34daccd could not be found. Jun 27 15:56:42.636236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:42.636236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:42.636236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:42.636236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:42.636236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:42.636236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:42.636236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:56:42.636236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:56:42.636236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a5fc50-738a-4228-9733-e9e7b34daccd could not be found. Jun 27 15:56:42.636236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:42.638790 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8b6b2842-3eac-4f08-8bf6-f1bdcd98eace tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Returning 404 to user: Instance 32a5fc50-738a-4228-9733-e9e7b34daccd could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:56:42.638790 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-8b6b2842-3eac-4f08-8bf6-f1bdcd98eace tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 404 len: 111 microversion: 2.20 time: 0.045877 Jun 27 15:56:42.638790 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 484/976] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:56:42 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:56:42.649473 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-7a45c065-c528-4093-9b99-4ec2ae8661bd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '.version_select at 0x7fe146489820>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:42.695414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-7a45c065-c528-4093-9b99-4ec2ae8661bd tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1218625900" status: 204 len: 0 microversion: 2.20 time: 0.053460 Jun 27 15:56:42.696637 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 493/977] 10.222.0.20 () {60 vars in 1261 bytes} [Mon Jun 27 15:56:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1218625900 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 15:56:42.743409 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-96659231-5a4f-4d67-8db2-6af218b023b3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:42.745009 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-96659231-5a4f-4d67-8db2-6af218b023b3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:42.755122 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-96659231-5a4f-4d67-8db2-6af218b023b3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:42.757163 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-96659231-5a4f-4d67-8db2-6af218b023b3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:42.757163 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-96659231-5a4f-4d67-8db2-6af218b023b3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:42.757163 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-96659231-5a4f-4d67-8db2-6af218b023b3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:42.775365 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-96659231-5a4f-4d67-8db2-6af218b023b3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] HTTP exception thrown: Instance 8f94baae-848b-491b-ba4e-56149f83856e could not be found. Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-96659231-5a4f-4d67-8db2-6af218b023b3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Request method failure captured: Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e HTTP/1.1 Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudKgwhUwXfk48AzZs0c5fmwwnDHGCcKPSCxkN5S5OSVIy6LsaEhk8pkOYw3Gba3WVv-Fl8yJFTEFhTCQMs2rJ8pHCHlMqrvqMWGswWTUzgomFdKB0h_BYFAabKkpg_N6pl3W9_BhGboKe81vFI9AcJFLfEjyn2HlzbkDBAwN4ZsQghM Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:56:42.778412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:56:42.780234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_90d9fb4d2e024e6eac7eeee72e63e904", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:56:42.780234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:56:42.780234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:56:42.780234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:56:42.780234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:56:42.780234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:56:42.780234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:56:42.780234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: ce59e0072f1c4b91a2825e5fecde7e23 Jun 27 15:56:42.780234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:56:42.780234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:56:42.780234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance 8f94baae-848b-491b-ba4e-56149f83856e could not be found. Jun 27 15:56:42.780234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': '8f94baae-848b-491b-ba4e-56149f83856e'} Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f94baae-848b-491b-ba4e-56149f83856e could not be found. Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:56:42.781154 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:56:42.782773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:56:42.782773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:56:42.782773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:56:42.782773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:56:42.782773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:56:42.782773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:56:42.782773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:56:42.782773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f94baae-848b-491b-ba4e-56149f83856e could not be found. Jun 27 15:56:42.782773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:42.782773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:42.782773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:42.782773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:42.782773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:42.782773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:42.782773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:56:42.782773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:56:42.782773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f94baae-848b-491b-ba4e-56149f83856e could not be found. Jun 27 15:56:42.782773 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:42.785227 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-96659231-5a4f-4d67-8db2-6af218b023b3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Returning 404 to user: Instance 8f94baae-848b-491b-ba4e-56149f83856e could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:56:42.786179 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-96659231-5a4f-4d67-8db2-6af218b023b3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 404 len: 111 microversion: 2.1 time: 0.053590 Jun 27 15:56:42.787751 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 485/978] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:42 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:56:42.803344 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-782a2fa1-0b7a-4794-89d4-806fda4c5173 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '.version_select at 0x7fe14aca8700>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:42.826703 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-782a2fa1-0b7a-4794-89d4-806fda4c5173 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-346015505" status: 202 len: 0 microversion: 2.1 time: 0.032463 Jun 27 15:56:42.827604 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 494/979] 10.222.0.20 () {58 vars in 1217 bytes} [Mon Jun 27 15:56:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-346015505 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:56:43.419236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-d83c8aa6-0b60-4e0a-a3e0-20aa1cefc013 req-66d1cf1f-5693-43f8-bec8-01dd7c28c6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f94baae-848b-491b-ba4e-56149f83856e", "name": "network-vif-deleted", "tag": "26242c74-174c-420a-bf02-44c87527d15f"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:56:43.434641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-d83c8aa6-0b60-4e0a-a3e0-20aa1cefc013 req-66d1cf1f-5693-43f8-bec8-01dd7c28c6d1 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:43.435845 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-d83c8aa6-0b60-4e0a-a3e0-20aa1cefc013 req-66d1cf1f-5693-43f8-bec8-01dd7c28c6d1 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:43.460294 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-d83c8aa6-0b60-4e0a-a3e0-20aa1cefc013 req-66d1cf1f-5693-43f8-bec8-01dd7c28c6d1 service nova] Creating event network-vif-deleted:26242c74-174c-420a-bf02-44c87527d15f for instance 8f94baae-848b-491b-ba4e-56149f83856e on hv-cinder-84780 Jun 27 15:56:43.470634 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-d83c8aa6-0b60-4e0a-a3e0-20aa1cefc013 req-66d1cf1f-5693-43f8-bec8-01dd7c28c6d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057716 Jun 27 15:56:43.472141 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 486/980] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:56:44.017617 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3d52cccb-e13c-4042-a0f0-b7f4b31dc949 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:44.018227 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3d52cccb-e13c-4042-a0f0-b7f4b31dc949 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:44.026571 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3d52cccb-e13c-4042-a0f0-b7f4b31dc949 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:44.027110 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3d52cccb-e13c-4042-a0f0-b7f4b31dc949 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:44.027956 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3d52cccb-e13c-4042-a0f0-b7f4b31dc949 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:44.028492 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3d52cccb-e13c-4042-a0f0-b7f4b31dc949 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:44.145210 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.objects.instance [None req-3d52cccb-e13c-4042-a0f0-b7f4b31dc949 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lazy-loading 'services' on Instance uuid f74d93df-6aac-45ba-83a0-4bafe2c375aa {{(pid=129473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:56:44.264980 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3d52cccb-e13c-4042-a0f0-b7f4b31dc949 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa/os-volume_attachments/5afd6fa8-456c-4679-8ae1-a748709bfbce" status: 202 len: 0 microversion: 2.1 time: 0.252331 Jun 27 15:56:44.265595 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 495/981] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 27 15:56:44 2022] DELETE /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa/os-volume_attachments/5afd6fa8-456c-4679-8ae1-a748709bfbce => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:56:44.276624 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-2a4ef1fb-a083-46dc-af39-beb1b380c101 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:44.277890 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-2a4ef1fb-a083-46dc-af39-beb1b380c101 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:44.285237 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2a4ef1fb-a083-46dc-af39-beb1b380c101 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:44.285691 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2a4ef1fb-a083-46dc-af39-beb1b380c101 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:44.287217 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2a4ef1fb-a083-46dc-af39-beb1b380c101 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:44.287853 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2a4ef1fb-a083-46dc-af39-beb1b380c101 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:44.326061 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-2a4ef1fb-a083-46dc-af39-beb1b380c101 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054617 Jun 27 15:56:44.326675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 487/982] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 27 15:56:44 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:56:44.952033 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a4c06173-f853-4dae-8200-8d23fd3ce414 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:44.952602 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-a4c06173-f853-4dae-8200-8d23fd3ce414 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:44.961105 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a4c06173-f853-4dae-8200-8d23fd3ce414 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:44.961908 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a4c06173-f853-4dae-8200-8d23fd3ce414 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:44.962847 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a4c06173-f853-4dae-8200-8d23fd3ce414 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:44.963536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-a4c06173-f853-4dae-8200-8d23fd3ce414 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:44.979835 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-a4c06173-f853-4dae-8200-8d23fd3ce414 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] HTTP exception thrown: Instance 32a5fc50-738a-4228-9733-e9e7b34daccd could not be found. Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a4c06173-f853-4dae-8200-8d23fd3ce414 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Request method failure captured: Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: DELETE /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd HTTP/1.1 Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudGT-29gJSaPG9yRbV3WCZW3eyz3_EztkPHwj0NbSTDMnF3G40kk8EaUr0pRdqYXBttyn45sIxL7Ex__hCs-mfI1OPIB7VGEnk3L-o3lbUuJSbudzww_VDODiLxWXJ_o-hW1Yfl1t0k-uPvmiKu11boP05BbWdlDOLlHyqn4vFO831U Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 5d416620e9f942ab9f76e6b117cd8b61 Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-614482775 Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:56:44.981667 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:56:44.984290 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d416620e9f942ab9f76e6b117cd8b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d416620e9f942ab9f76e6b117cd8b61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d416620e9f942ab9f76e6b117cd8b61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d416620e9f942ab9f76e6b117cd8b61", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:56:44.984290 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-AttachVolumeShelveTestJSON-614482775 Jun 27 15:56:44.984290 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 5d416620e9f942ab9f76e6b117cd8b61 Jun 27 15:56:44.984290 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-614482775 Jun 27 15:56:44.984290 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-AttachVolumeShelveTestJSON-614482775-project Jun 27 15:56:44.984290 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:56:44.984290 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:56:44.984290 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 6890639a0a2e4ca9b103919fdbbffc5b Jun 27 15:56:44.984290 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-AttachVolumeShelveTestJSON-614482775-project Jun 27 15:56:44.984290 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:56:44.984290 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance 32a5fc50-738a-4228-9733-e9e7b34daccd could not be found. Jun 27 15:56:44.984290 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': '32a5fc50-738a-4228-9733-e9e7b34daccd'} Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a5fc50-738a-4228-9733-e9e7b34daccd could not be found. Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:56:44.988032 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a5fc50-738a-4228-9733-e9e7b34daccd could not be found. Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a5fc50-738a-4228-9733-e9e7b34daccd could not be found. Jun 27 15:56:44.991838 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:44.994028 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a4c06173-f853-4dae-8200-8d23fd3ce414 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Returning 404 to user: Instance 32a5fc50-738a-4228-9733-e9e7b34daccd could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:56:44.994028 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a4c06173-f853-4dae-8200-8d23fd3ce414 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "DELETE /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 404 len: 111 microversion: 2.20 time: 0.036318 Jun 27 15:56:44.994028 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 496/983] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Jun 27 15:56:44 2022] DELETE /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 27 15:56:45.000095 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-014d3748-000f-4407-8a30-c6ccb6c283d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:45.000747 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-014d3748-000f-4407-8a30-c6ccb6c283d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: 32a5fc50-738a-4228-9733-e9e7b34daccd] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:45.007674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-014d3748-000f-4407-8a30-c6ccb6c283d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:45.008158 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-014d3748-000f-4407-8a30-c6ccb6c283d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:45.008943 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-014d3748-000f-4407-8a30-c6ccb6c283d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:45.009388 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-014d3748-000f-4407-8a30-c6ccb6c283d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:45.025463 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-014d3748-000f-4407-8a30-c6ccb6c283d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] HTTP exception thrown: Instance 32a5fc50-738a-4228-9733-e9e7b34daccd could not be found. Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-014d3748-000f-4407-8a30-c6ccb6c283d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Request method failure captured: Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd HTTP/1.1 Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudGT-29gJSaPG9yRbV3WCZW3eyz3_EztkPHwj0NbSTDMnF3G40kk8EaUr0pRdqYXBttyn45sIxL7Ex__hCs-mfI1OPIB7VGEnk3L-o3lbUuJSbudzww_VDODiLxWXJ_o-hW1Yfl1t0k-uPvmiKu11boP05BbWdlDOLlHyqn4vFO831U Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 5d416620e9f942ab9f76e6b117cd8b61 Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-614482775 Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:56:45.027350 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:56:45.030009 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d416620e9f942ab9f76e6b117cd8b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d416620e9f942ab9f76e6b117cd8b61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d416620e9f942ab9f76e6b117cd8b61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d416620e9f942ab9f76e6b117cd8b61", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:56:45.030009 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-AttachVolumeShelveTestJSON-614482775 Jun 27 15:56:45.030009 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 5d416620e9f942ab9f76e6b117cd8b61 Jun 27 15:56:45.030009 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-614482775 Jun 27 15:56:45.030009 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-AttachVolumeShelveTestJSON-614482775-project Jun 27 15:56:45.030009 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:56:45.030009 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:56:45.030009 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: 6890639a0a2e4ca9b103919fdbbffc5b Jun 27 15:56:45.030009 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-AttachVolumeShelveTestJSON-614482775-project Jun 27 15:56:45.030009 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:56:45.030009 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance 32a5fc50-738a-4228-9733-e9e7b34daccd could not be found. Jun 27 15:56:45.030009 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': '32a5fc50-738a-4228-9733-e9e7b34daccd'} Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a5fc50-738a-4228-9733-e9e7b34daccd could not be found. Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:56:45.030834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:56:45.032280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:56:45.032280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:56:45.032280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:56:45.032280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:56:45.032280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:56:45.032280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:56:45.032280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:56:45.032280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a5fc50-738a-4228-9733-e9e7b34daccd could not be found. Jun 27 15:56:45.032280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:45.032280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:45.032280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:45.032280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:45.032280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:45.032280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:45.032280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:56:45.032280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:56:45.032280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a5fc50-738a-4228-9733-e9e7b34daccd could not be found. Jun 27 15:56:45.032280 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:45.033992 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-014d3748-000f-4407-8a30-c6ccb6c283d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Returning 404 to user: Instance 32a5fc50-738a-4228-9733-e9e7b34daccd could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:56:45.033992 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-014d3748-000f-4407-8a30-c6ccb6c283d9 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd" status: 404 len: 111 microversion: 2.20 time: 0.033360 Jun 27 15:56:45.033992 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 488/984] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:56:44 2022] GET /compute/v2.1/servers/32a5fc50-738a-4228-9733-e9e7b34daccd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:56:45.337937 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-872205b1-1767-4039-90ad-72edee702364 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:45.339504 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-872205b1-1767-4039-90ad-72edee702364 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:45.353023 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-872205b1-1767-4039-90ad-72edee702364 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:45.353743 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-872205b1-1767-4039-90ad-72edee702364 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:45.355126 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-872205b1-1767-4039-90ad-72edee702364 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:45.355860 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-872205b1-1767-4039-90ad-72edee702364 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:45.406574 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-872205b1-1767-4039-90ad-72edee702364 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072812 Jun 27 15:56:45.407163 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 497/985] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 27 15:56:45 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 15:56:45.479586 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8e38044c-e7e1-4049-82b2-523a0a17a52a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:45.480203 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8e38044c-e7e1-4049-82b2-523a0a17a52a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:45.487747 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8e38044c-e7e1-4049-82b2-523a0a17a52a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:45.488384 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8e38044c-e7e1-4049-82b2-523a0a17a52a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:45.489047 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8e38044c-e7e1-4049-82b2-523a0a17a52a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:45.491377 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8e38044c-e7e1-4049-82b2-523a0a17a52a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:45.522113 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8e38044c-e7e1-4049-82b2-523a0a17a52a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Going to try to terminate instance {{(pid=129472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:56:45.615901 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-8e38044c-e7e1-4049-82b2-523a0a17a52a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 204 len: 0 microversion: 2.1 time: 0.140347 Jun 27 15:56:45.616570 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 489/986] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:56:45 2022] DELETE /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:56:45.627770 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-cdc53ffd-550a-455c-a252-ba7b21f96b86 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:45.628570 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-cdc53ffd-550a-455c-a252-ba7b21f96b86 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:45.636614 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cdc53ffd-550a-455c-a252-ba7b21f96b86 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:45.637126 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cdc53ffd-550a-455c-a252-ba7b21f96b86 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:45.637977 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cdc53ffd-550a-455c-a252-ba7b21f96b86 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:45.638417 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cdc53ffd-550a-455c-a252-ba7b21f96b86 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:45.800947 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-cdc53ffd-550a-455c-a252-ba7b21f96b86 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:45.809803 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-cdc53ffd-550a-455c-a252-ba7b21f96b86 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 200 len: 1682 microversion: 2.1 time: 0.186657 Jun 27 15:56:45.810644 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 498/987] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:45 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:56:46.193937 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c94c9ec8-88b6-4d24-be0d-e751e0eff8e2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:46.194955 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c94c9ec8-88b6-4d24-be0d-e751e0eff8e2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:46.205794 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c94c9ec8-88b6-4d24-be0d-e751e0eff8e2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:46.206486 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c94c9ec8-88b6-4d24-be0d-e751e0eff8e2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:46.207723 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c94c9ec8-88b6-4d24-be0d-e751e0eff8e2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:46.208498 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c94c9ec8-88b6-4d24-be0d-e751e0eff8e2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:46.236952 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-c94c9ec8-88b6-4d24-be0d-e751e0eff8e2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] HTTP exception thrown: Instance b9cda787-8842-478e-9fae-1c95d057875f could not be found. Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c94c9ec8-88b6-4d24-be0d-e751e0eff8e2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Request method failure captured: Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: DELETE /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f HTTP/1.1 Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudGT-29gJSaPG9yRbV3WCZW3eyz3_EztkPHwj0NbSTDMnF3G40kk8EaUr0pRdqYXBttyn45sIxL7Ex__hCs-mfI1OPIB7VGEnk3L-o3lbUuJSbudzww_VDODiLxWXJ_o-hW1Yfl1t0k-uPvmiKu11boP05BbWdlDOLlHyqn4vFO831U Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 5d416620e9f942ab9f76e6b117cd8b61 Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-614482775 Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:56:46.240852 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:56:46.243543 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d416620e9f942ab9f76e6b117cd8b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d416620e9f942ab9f76e6b117cd8b61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d416620e9f942ab9f76e6b117cd8b61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d416620e9f942ab9f76e6b117cd8b61", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:56:46.243543 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-AttachVolumeShelveTestJSON-614482775 Jun 27 15:56:46.243543 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 5d416620e9f942ab9f76e6b117cd8b61 Jun 27 15:56:46.243543 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-614482775 Jun 27 15:56:46.243543 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-AttachVolumeShelveTestJSON-614482775-project Jun 27 15:56:46.243543 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:56:46.243543 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:56:46.243543 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: 6890639a0a2e4ca9b103919fdbbffc5b Jun 27 15:56:46.243543 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-AttachVolumeShelveTestJSON-614482775-project Jun 27 15:56:46.243543 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:56:46.243543 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance b9cda787-8842-478e-9fae-1c95d057875f could not be found. Jun 27 15:56:46.243543 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': 'b9cda787-8842-478e-9fae-1c95d057875f'} Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9cda787-8842-478e-9fae-1c95d057875f could not be found. Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:56:46.245285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9cda787-8842-478e-9fae-1c95d057875f could not be found. Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9cda787-8842-478e-9fae-1c95d057875f could not be found. Jun 27 15:56:46.247807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:46.250399 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c94c9ec8-88b6-4d24-be0d-e751e0eff8e2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Returning 404 to user: Instance b9cda787-8842-478e-9fae-1c95d057875f could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:56:46.250399 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c94c9ec8-88b6-4d24-be0d-e751e0eff8e2 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 404 len: 111 microversion: 2.20 time: 0.057439 Jun 27 15:56:46.250399 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 490/988] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Jun 27 15:56:46 2022] DELETE /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:56:46.256282 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-26c6928e-c0cb-4030-b0be-96d376c31903 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:46.256903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-26c6928e-c0cb-4030-b0be-96d376c31903 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] [instance: b9cda787-8842-478e-9fae-1c95d057875f] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:46.263887 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-26c6928e-c0cb-4030-b0be-96d376c31903 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:46.264534 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-26c6928e-c0cb-4030-b0be-96d376c31903 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:46.265342 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-26c6928e-c0cb-4030-b0be-96d376c31903 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:46.265923 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-26c6928e-c0cb-4030-b0be-96d376c31903 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:46.283015 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-26c6928e-c0cb-4030-b0be-96d376c31903 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] HTTP exception thrown: Instance b9cda787-8842-478e-9fae-1c95d057875f could not be found. Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-26c6928e-c0cb-4030-b0be-96d376c31903 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Request method failure captured: Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f HTTP/1.1 Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudGT-29gJSaPG9yRbV3WCZW3eyz3_EztkPHwj0NbSTDMnF3G40kk8EaUr0pRdqYXBttyn45sIxL7Ex__hCs-mfI1OPIB7VGEnk3L-o3lbUuJSbudzww_VDODiLxWXJ_o-hW1Yfl1t0k-uPvmiKu11boP05BbWdlDOLlHyqn4vFO831U Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 5d416620e9f942ab9f76e6b117cd8b61 Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-614482775 Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:56:46.284693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:56:46.288044 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d416620e9f942ab9f76e6b117cd8b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d416620e9f942ab9f76e6b117cd8b61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d416620e9f942ab9f76e6b117cd8b61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d416620e9f942ab9f76e6b117cd8b61", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:56:46.288044 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-AttachVolumeShelveTestJSON-614482775 Jun 27 15:56:46.288044 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 5d416620e9f942ab9f76e6b117cd8b61 Jun 27 15:56:46.288044 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-614482775 Jun 27 15:56:46.288044 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-AttachVolumeShelveTestJSON-614482775-project Jun 27 15:56:46.288044 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:56:46.288044 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:56:46.288044 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 6890639a0a2e4ca9b103919fdbbffc5b Jun 27 15:56:46.288044 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-AttachVolumeShelveTestJSON-614482775-project Jun 27 15:56:46.288044 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:56:46.288044 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance b9cda787-8842-478e-9fae-1c95d057875f could not be found. Jun 27 15:56:46.288044 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': 'b9cda787-8842-478e-9fae-1c95d057875f'} Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9cda787-8842-478e-9fae-1c95d057875f could not be found. Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:56:46.289475 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:56:46.291894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:56:46.291894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:56:46.291894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:56:46.291894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:56:46.291894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:56:46.291894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:56:46.291894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:56:46.291894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9cda787-8842-478e-9fae-1c95d057875f could not be found. Jun 27 15:56:46.291894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:46.291894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:46.291894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:46.291894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:46.291894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:46.291894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:46.291894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:56:46.291894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:56:46.291894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9cda787-8842-478e-9fae-1c95d057875f could not be found. Jun 27 15:56:46.291894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:46.294244 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-26c6928e-c0cb-4030-b0be-96d376c31903 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] Returning 404 to user: Instance b9cda787-8842-478e-9fae-1c95d057875f could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:56:46.294244 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-26c6928e-c0cb-4030-b0be-96d376c31903 tempest-AttachVolumeShelveTestJSON-614482775 tempest-AttachVolumeShelveTestJSON-614482775-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f" status: 404 len: 111 microversion: 2.20 time: 0.034984 Jun 27 15:56:46.294244 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 499/989] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jun 27 15:56:46 2022] GET /compute/v2.1/servers/b9cda787-8842-478e-9fae-1c95d057875f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:56:46.831641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-39f15274-919b-40b2-bd9b-dc20e60d65e2 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:46.832436 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-39f15274-919b-40b2-bd9b-dc20e60d65e2 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:46.842512 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-39f15274-919b-40b2-bd9b-dc20e60d65e2 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:46.843073 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-39f15274-919b-40b2-bd9b-dc20e60d65e2 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:46.843961 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-39f15274-919b-40b2-bd9b-dc20e60d65e2 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:46.844482 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-39f15274-919b-40b2-bd9b-dc20e60d65e2 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:47.118095 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-39f15274-919b-40b2-bd9b-dc20e60d65e2 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:47.127180 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-39f15274-919b-40b2-bd9b-dc20e60d65e2 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 200 len: 1682 microversion: 2.1 time: 0.300856 Jun 27 15:56:47.127765 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 491/990] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:46 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 1682 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:48.163665 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-24abe710-f0b6-460e-9906-f7777d955097 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:48.164932 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-24abe710-f0b6-460e-9906-f7777d955097 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:48.178770 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-24abe710-f0b6-460e-9906-f7777d955097 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:48.181488 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-24abe710-f0b6-460e-9906-f7777d955097 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:48.183317 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-24abe710-f0b6-460e-9906-f7777d955097 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:48.184589 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-24abe710-f0b6-460e-9906-f7777d955097 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:48.347830 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-24abe710-f0b6-460e-9906-f7777d955097 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:48.360520 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-24abe710-f0b6-460e-9906-f7777d955097 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 200 len: 1614 microversion: 2.1 time: 0.206391 Jun 27 15:56:48.361575 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 500/991] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:48 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 1614 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:49.075068 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-98875ca5-a8f9-4310-a5ad-fcc0ccd6671d req-6c364bad-9a28-429e-ba9e-023570c5d776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f74d93df-6aac-45ba-83a0-4bafe2c375aa", "name": "network-vif-deleted", "tag": "fef1e9fb-3e92-48c7-9b07-aaf3cd512ad4"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:56:49.091436 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-98875ca5-a8f9-4310-a5ad-fcc0ccd6671d req-6c364bad-9a28-429e-ba9e-023570c5d776 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:49.092246 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-98875ca5-a8f9-4310-a5ad-fcc0ccd6671d req-6c364bad-9a28-429e-ba9e-023570c5d776 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:49.118108 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-98875ca5-a8f9-4310-a5ad-fcc0ccd6671d req-6c364bad-9a28-429e-ba9e-023570c5d776 service nova] Creating event network-vif-deleted:fef1e9fb-3e92-48c7-9b07-aaf3cd512ad4 for instance f74d93df-6aac-45ba-83a0-4bafe2c375aa on hv-cinder-84780 Jun 27 15:56:49.125912 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-98875ca5-a8f9-4310-a5ad-fcc0ccd6671d req-6c364bad-9a28-429e-ba9e-023570c5d776 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054042 Jun 27 15:56:49.126839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 492/992] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:56:49.392901 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ec10633e-7f66-470f-abe8-985f5bbfd78a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:49.395404 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-ec10633e-7f66-470f-abe8-985f5bbfd78a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:49.413069 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ec10633e-7f66-470f-abe8-985f5bbfd78a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:49.414496 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ec10633e-7f66-470f-abe8-985f5bbfd78a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:49.416638 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ec10633e-7f66-470f-abe8-985f5bbfd78a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:49.417913 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ec10633e-7f66-470f-abe8-985f5bbfd78a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:49.495966 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ec10633e-7f66-470f-abe8-985f5bbfd78a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:49.497704 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ec10633e-7f66-470f-abe8-985f5bbfd78a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:49.498756 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.objects.instance [None req-ec10633e-7f66-470f-abe8-985f5bbfd78a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lazy-loading 'fault' on Instance uuid f74d93df-6aac-45ba-83a0-4bafe2c375aa {{(pid=129473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:56:49.595986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-ec10633e-7f66-470f-abe8-985f5bbfd78a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:49.614812 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-ec10633e-7f66-470f-abe8-985f5bbfd78a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 200 len: 1332 microversion: 2.1 time: 0.229083 Jun 27 15:56:49.618324 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 501/993] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:49 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 1332 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:50.650608 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-fdd2cf48-3bd7-4cbc-a12f-bdc2a40a49c4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:50.652050 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-fdd2cf48-3bd7-4cbc-a12f-bdc2a40a49c4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:50.665330 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fdd2cf48-3bd7-4cbc-a12f-bdc2a40a49c4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:50.670552 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fdd2cf48-3bd7-4cbc-a12f-bdc2a40a49c4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:50.671619 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fdd2cf48-3bd7-4cbc-a12f-bdc2a40a49c4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:50.672856 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fdd2cf48-3bd7-4cbc-a12f-bdc2a40a49c4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:50.700819 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-fdd2cf48-3bd7-4cbc-a12f-bdc2a40a49c4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] HTTP exception thrown: Instance f74d93df-6aac-45ba-83a0-4bafe2c375aa could not be found. Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-fdd2cf48-3bd7-4cbc-a12f-bdc2a40a49c4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Request method failure captured: Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa HTTP/1.1 Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudKgwhUwXfk48AzZs0c5fmwwnDHGCcKPSCxkN5S5OSVIy6LsaEhk8pkOYw3Gba3WVv-Fl8yJFTEFhTCQMs2rJ8pHCHlMqrvqMWGswWTUzgomFdKB0h_BYFAabKkpg_N6pl3W9_BhGboKe81vFI9AcJFLfEjyn2HlzbkDBAwN4ZsQghM Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:56:50.703698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:56:50.705716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_90d9fb4d2e024e6eac7eeee72e63e904", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:56:50.705716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:56:50.705716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:56:50.705716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:56:50.705716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:56:50.705716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:56:50.705716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:56:50.705716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: ce59e0072f1c4b91a2825e5fecde7e23 Jun 27 15:56:50.705716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:56:50.705716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:56:50.705716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance f74d93df-6aac-45ba-83a0-4bafe2c375aa could not be found. Jun 27 15:56:50.705716 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': 'f74d93df-6aac-45ba-83a0-4bafe2c375aa'} Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f74d93df-6aac-45ba-83a0-4bafe2c375aa could not be found. Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:56:50.706851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:56:50.708542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:56:50.708542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:56:50.708542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:56:50.708542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:56:50.708542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:56:50.708542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:56:50.708542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:56:50.708542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f74d93df-6aac-45ba-83a0-4bafe2c375aa could not be found. Jun 27 15:56:50.708542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:50.708542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:50.708542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:50.708542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:50.708542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:50.708542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:50.708542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:56:50.708542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:56:50.708542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f74d93df-6aac-45ba-83a0-4bafe2c375aa could not be found. Jun 27 15:56:50.708542 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:50.711214 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-fdd2cf48-3bd7-4cbc-a12f-bdc2a40a49c4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Returning 404 to user: Instance f74d93df-6aac-45ba-83a0-4bafe2c375aa could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:56:50.712614 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-fdd2cf48-3bd7-4cbc-a12f-bdc2a40a49c4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 404 len: 111 microversion: 2.1 time: 0.077985 Jun 27 15:56:50.726457 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c0b3fd51-15a4-4ad7-8a6b-0387247ffdd5 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '.version_select at 0x7fe1464564c0>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:50.731587 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 493/994] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:50 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:56:50.779716 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c0b3fd51-15a4-4ad7-8a6b-0387247ffdd5 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1735451729" status: 202 len: 0 microversion: 2.1 time: 0.055190 Jun 27 15:56:50.780283 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 502/995] 10.222.0.20 () {58 vars in 1220 bytes} [Mon Jun 27 15:56:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1735451729 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:56:51.886408 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-03a0d6c7-f838-438b-9201-d4e8fe904538 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Action: 'create', calling method: .version_select at 0x7fe145bc6160>, body: {"keypair": {"name": "tempest-keypair-825078713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyzOIalbkTChmJnrAnFdSdIOsR1oC/YCqBl8wn4qtt8mvNWn9Uaxky03Clr5geapBzCOKzdCkc4JVrNps/cixq5OUPy4DeMDMQzGXi5M1rTFlJfRuBa8KmbXdHR+Hi06Q=="}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:56:51.905839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-03a0d6c7-f838-438b-9201-d4e8fe904538 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Getting quotas for project 90d9fb4d2e024e6eac7eeee72e63e904. Resources: {'key_pairs'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:56:51.913515 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-03a0d6c7-f838-438b-9201-d4e8fe904538 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Getting quotas for user ce59e0072f1c4b91a2825e5fecde7e23 and project 90d9fb4d2e024e6eac7eeee72e63e904. Resources: {'key_pairs'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:56:51.943237 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-03a0d6c7-f838-438b-9201-d4e8fe904538 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060397 Jun 27 15:56:51.951423 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 494/996] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 27 15:56:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:56:53.047001 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-85dd8b8f-1a38-4d62-908e-7af327bfbc5e tempest-VolumesGetTestJSON-808099011 tempest-VolumesGetTestJSON-808099011-project] Action: 'create', calling method: .version_select at 0x7fe1464891f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1681096998", "metadata": {"Type": "work"}}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:56:53.474381 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-85dd8b8f-1a38-4d62-908e-7af327bfbc5e tempest-VolumesGetTestJSON-808099011 tempest-VolumesGetTestJSON-808099011-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.599976 Jun 27 15:56:53.475389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 503/997] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Jun 27 15:56:52 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 605 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 27 15:56:53.490742 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f6efbabf-329b-4c12-bf22-366d0649abc2 tempest-VolumesGetTestJSON-808099011 tempest-VolumesGetTestJSON-808099011-project] Calling method '.version_select at 0x7fe145e0d430>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:53.547069 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f6efbabf-329b-4c12-bf22-366d0649abc2 tempest-VolumesGetTestJSON-808099011 tempest-VolumesGetTestJSON-808099011-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/4ee9c83d-ffa4-4f87-8951-230f89a92fba" status: 200 len: 353 microversion: 2.1 time: 0.061324 Jun 27 15:56:53.547682 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 495/998] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 27 15:56:53 2022] GET /compute/v2.1/os-volumes/4ee9c83d-ffa4-4f87-8951-230f89a92fba => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:56:53.866852 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c8301f0f-8690-4c08-858a-ab0f0684a226 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2138654950", "imageRef": "11f9be98-90d6-4c67-8d66-0b944f5a2a2b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db23eeee-31f0-406e-a989-356a481d9808"}], "security_groups": [{"name": "tempest-securitygroup--1547557128"}], "key_name": "tempest-keypair-825078713", "user_data": "}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:56:53.995660 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.network.neutron [None req-c8301f0f-8690-4c08-858a-ab0f0684a226 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] validate_networks() for [('db23eeee-31f0-406e-a989-356a481d9808', None, None, None, None, None)] {{(pid=129473) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:56:54.512538 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-c8301f0f-8690-4c08-858a-ab0f0684a226 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Flavor limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:56:54.513295 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-c8301f0f-8690-4c08-858a-ab0f0684a226 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Image limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:56:54.513435 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-c8301f0f-8690-4c08-858a-ab0f0684a226 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Flavor pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:56:54.513888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-c8301f0f-8690-4c08-858a-ab0f0684a226 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Image pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:56:54.514311 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-c8301f0f-8690-4c08-858a-ab0f0684a226 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:56:54.526162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c8301f0f-8690-4c08-858a-ab0f0684a226 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:54.526676 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c8301f0f-8690-4c08-858a-ab0f0684a226 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:54.527549 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c8301f0f-8690-4c08-858a-ab0f0684a226 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:54.528064 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c8301f0f-8690-4c08-858a-ab0f0684a226 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:54.553345 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-c8301f0f-8690-4c08-858a-ab0f0684a226 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Getting quotas for project 90d9fb4d2e024e6eac7eeee72e63e904. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:56:54.558542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-c8301f0f-8690-4c08-858a-ab0f0684a226 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Getting quotas for user ce59e0072f1c4b91a2825e5fecde7e23 and project 90d9fb4d2e024e6eac7eeee72e63e904. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:56:54.564831 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-7291d73f-7a5c-4fcb-85bd-8ebc434e44a8 tempest-VolumesGetTestJSON-808099011 tempest-VolumesGetTestJSON-808099011-project] Calling method '.version_select at 0x7fe145e0d700>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:54.573659 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c8301f0f-8690-4c08-858a-ab0f0684a226 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Going to run 1 instances... {{(pid=129473) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:56:54.576205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c8301f0f-8690-4c08-858a-ab0f0684a226 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11f9be98-90d6-4c67-8d66-0b944f5a2a2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:56:54.633610 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c8301f0f-8690-4c08-858a-ab0f0684a226 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.775266 Jun 27 15:56:54.637933 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-7291d73f-7a5c-4fcb-85bd-8ebc434e44a8 tempest-VolumesGetTestJSON-808099011 tempest-VolumesGetTestJSON-808099011-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/4ee9c83d-ffa4-4f87-8951-230f89a92fba" status: 200 len: 354 microversion: 2.1 time: 0.080024 Jun 27 15:56:54.641727 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 496/999] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 27 15:56:54 2022] GET /compute/v2.1/os-volumes/4ee9c83d-ffa4-4f87-8951-230f89a92fba => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:56:54.641917 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 504/1000] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 15:56:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:56:54.650248 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-20f95665-d097-4bc0-bbf1-e9f58847166c tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:54.651014 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-20f95665-d097-4bc0-bbf1-e9f58847166c tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:54.654824 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-da90f572-03ba-4b41-b543-2363dfae9567 tempest-VolumesGetTestJSON-808099011 tempest-VolumesGetTestJSON-808099011-project] Calling method '.version_select at 0x7fe1464893a0>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:54.712910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-da90f572-03ba-4b41-b543-2363dfae9567 tempest-VolumesGetTestJSON-808099011 tempest-VolumesGetTestJSON-808099011-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/4ee9c83d-ffa4-4f87-8951-230f89a92fba" status: 200 len: 354 microversion: 2.1 time: 0.062083 Jun 27 15:56:54.714445 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 505/1001] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 27 15:56:54 2022] GET /compute/v2.1/os-volumes/4ee9c83d-ffa4-4f87-8951-230f89a92fba => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:56:54.726500 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-2bbce9f5-6366-4c3a-830b-8b53af226aab tempest-VolumesGetTestJSON-808099011 tempest-VolumesGetTestJSON-808099011-project] Calling method '.version_select at 0x7fe14acf3160>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:54.751516 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-20f95665-d097-4bc0-bbf1-e9f58847166c tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:54.764006 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-20f95665-d097-4bc0-bbf1-e9f58847166c tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff" status: 200 len: 1241 microversion: 2.1 time: 0.121269 Jun 27 15:56:54.765048 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 497/1002] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:54 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff => generated 1241 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:54.827023 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-2bbce9f5-6366-4c3a-830b-8b53af226aab tempest-VolumesGetTestJSON-808099011 tempest-VolumesGetTestJSON-808099011-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/4ee9c83d-ffa4-4f87-8951-230f89a92fba" status: 202 len: 0 microversion: 2.1 time: 0.104697 Jun 27 15:56:54.828467 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 506/1003] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 27 15:56:54 2022] DELETE /compute/v2.1/os-volumes/4ee9c83d-ffa4-4f87-8951-230f89a92fba => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:56:54.839352 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-70e917e7-0c29-45bc-b7c5-b7c4eace4b4a tempest-VolumesGetTestJSON-808099011 tempest-VolumesGetTestJSON-808099011-project] Calling method '.version_select at 0x7fe145bb5ee0>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:54.917604 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-70e917e7-0c29-45bc-b7c5-b7c4eace4b4a tempest-VolumesGetTestJSON-808099011 tempest-VolumesGetTestJSON-808099011-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/4ee9c83d-ffa4-4f87-8951-230f89a92fba" status: 200 len: 353 microversion: 2.1 time: 0.082531 Jun 27 15:56:54.918488 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 498/1004] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 27 15:56:54 2022] GET /compute/v2.1/os-volumes/4ee9c83d-ffa4-4f87-8951-230f89a92fba => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:56:55.796922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e571c0bb-6893-4829-9a3d-6de9dc8a9ed8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:55.806612 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e571c0bb-6893-4829-9a3d-6de9dc8a9ed8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:55.818488 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e571c0bb-6893-4829-9a3d-6de9dc8a9ed8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:55.819152 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e571c0bb-6893-4829-9a3d-6de9dc8a9ed8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:55.820266 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e571c0bb-6893-4829-9a3d-6de9dc8a9ed8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:55.821166 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e571c0bb-6893-4829-9a3d-6de9dc8a9ed8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:55.936327 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e571c0bb-6893-4829-9a3d-6de9dc8a9ed8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:55.941738 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-12eaf3a7-94cc-49a6-8f92-ed17591b53da tempest-VolumesGetTestJSON-808099011 tempest-VolumesGetTestJSON-808099011-project] Calling method '.version_select at 0x7fe145d03430>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:55.946890 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e571c0bb-6893-4829-9a3d-6de9dc8a9ed8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff" status: 200 len: 1301 microversion: 2.1 time: 0.160226 Jun 27 15:56:55.950539 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 507/1005] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:55 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff => generated 1301 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:56:55.999021 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-12eaf3a7-94cc-49a6-8f92-ed17591b53da tempest-VolumesGetTestJSON-808099011 tempest-VolumesGetTestJSON-808099011-project] HTTP exception thrown: Volume 4ee9c83d-ffa4-4f87-8951-230f89a92fba could not be found. Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-12eaf3a7-94cc-49a6-8f92-ed17591b53da tempest-VolumesGetTestJSON-808099011 tempest-VolumesGetTestJSON-808099011-project] Request method failure captured: Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/os-volumes/4ee9c83d-ffa4-4f87-8951-230f89a92fba HTTP/1.1 Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudNEmyK2mXQTkS0ulVFXE2oxXiTPsMQ01FXvr-Qs6S3zLIkTM7d9dPn6woy8DfVZf7O8l1HHr68MgmzdJwXo4PH19YKh7sAsD3HzBNcaxtWGgjU_JmsBcBw6RnlBIytiDkKTrOO36WBeE8bPqI227Mp95PMPY-wLv2sH7kVkvDCrOgM Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 854bcd38c49a4a6b8123b58d7deae9d3 Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-VolumesGetTestJSON-808099011 Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:56:56.001567 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:56:56.006636 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/854bcd38c49a4a6b8123b58d7deae9d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/854bcd38c49a4a6b8123b58d7deae9d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/854bcd38c49a4a6b8123b58d7deae9d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_854bcd38c49a4a6b8123b58d7deae9d3", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:56:56.006636 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-VolumesGetTestJSON-808099011 Jun 27 15:56:56.006636 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 854bcd38c49a4a6b8123b58d7deae9d3 Jun 27 15:56:56.006636 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-VolumesGetTestJSON-808099011 Jun 27 15:56:56.006636 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-VolumesGetTestJSON-808099011-project Jun 27 15:56:56.006636 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:56:56.006636 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:56:56.006636 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: e7e01930895646ee94ab7e30ad2e49d0 Jun 27 15:56:56.006636 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-VolumesGetTestJSON-808099011-project Jun 27 15:56:56.006636 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: Jun 27 15:56:56.006636 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Volume 4ee9c83d-ffa4-4f87-8951-230f89a92fba could not be found. Jun 27 15:56:56.006636 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': '4ee9c83d-ffa4-4f87-8951-230f89a92fba'} Jun 27 15:56:56.006636 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:56:56.008495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:56.008495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:56:56.008495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:56:56.008495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:56:56.008495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:56:56.008495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:56:56.008495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:56:56.008495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:56:56.008495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:56:56.008495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:56:56.008495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:56:56.008495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:56:56.008495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:56:56.008495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:56:56.008495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:56:56.008495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4ee9c83d-ffa4-4f87-8951-230f89a92fba could not be found. (HTTP 404) (Request-ID: req-8b0b8f4e-1586-4936-a06c-bfe4e480dc67) Jun 27 15:56:56.008495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:56.008495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:56.008495 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:56.012873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:56.012873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 15:56:56.012873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 15:56:56.012873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:56:56.012873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:56:56.012873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:56:56.012873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:56:56.012873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:56:56.012873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:56:56.012873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:56:56.012873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:56:56.012873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:56:56.012873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:56:56.012873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:56:56.012873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:56:56.012873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:56:56.012873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:56:56.012873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:56:56.012873 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:56:56.019286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:56:56.019286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:56:56.019286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:56:56.019286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:56:56.019286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4ee9c83d-ffa4-4f87-8951-230f89a92fba could not be found. Jun 27 15:56:56.019286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:56.019286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:56.019286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:56.019286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:56.019286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:56.019286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:56.019286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:56:56.019286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:56:56.019286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:56:56.019286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:56:56.019286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:56:56.019286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:56:56.019286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 15:56:56.019286 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:56:56.023675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4ee9c83d-ffa4-4f87-8951-230f89a92fba could not be found. Jun 27 15:56:56.023675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:56.023675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:56.023675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:56.023675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:56.023675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:56.023675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:56.023675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:56:56.023675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:56:56.023675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4ee9c83d-ffa4-4f87-8951-230f89a92fba could not be found. Jun 27 15:56:56.023675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:56:56.023675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-12eaf3a7-94cc-49a6-8f92-ed17591b53da tempest-VolumesGetTestJSON-808099011 tempest-VolumesGetTestJSON-808099011-project] Returning 404 to user: Volume 4ee9c83d-ffa4-4f87-8951-230f89a92fba could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:56:56.023675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-12eaf3a7-94cc-49a6-8f92-ed17591b53da tempest-VolumesGetTestJSON-808099011 tempest-VolumesGetTestJSON-808099011-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/4ee9c83d-ffa4-4f87-8951-230f89a92fba" status: 404 len: 109 microversion: 2.1 time: 0.072223 Jun 27 15:56:56.023675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 499/1006] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 27 15:56:55 2022] GET /compute/v2.1/os-volumes/4ee9c83d-ffa4-4f87-8951-230f89a92fba => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:56:56.973009 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f4fcd506-f2d6-4c68-b097-9c916f44ba91 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:56.974122 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-f4fcd506-f2d6-4c68-b097-9c916f44ba91 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:56.997120 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f4fcd506-f2d6-4c68-b097-9c916f44ba91 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:56.997567 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f4fcd506-f2d6-4c68-b097-9c916f44ba91 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:57.001486 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f4fcd506-f2d6-4c68-b097-9c916f44ba91 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:57.002278 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-f4fcd506-f2d6-4c68-b097-9c916f44ba91 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:57.212426 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-f4fcd506-f2d6-4c68-b097-9c916f44ba91 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:57.220880 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f4fcd506-f2d6-4c68-b097-9c916f44ba91 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff" status: 200 len: 1367 microversion: 2.1 time: 0.256034 Jun 27 15:56:57.232099 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 508/1007] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:56 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:57.952741 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-8ad1fcca-b3a0-4f1c-ad95-10932423b750 req-84310d0e-3dfa-4b6f-bbcc-2e797f9b8d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3facdf2-b6fd-4e91-beb1-3eda459500ff", "tag": "3756e267-a334-4ee1-9124-fa7964f67701"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:56:57.969199 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-8ad1fcca-b3a0-4f1c-ad95-10932423b750 req-84310d0e-3dfa-4b6f-bbcc-2e797f9b8d25 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:57.970015 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-8ad1fcca-b3a0-4f1c-ad95-10932423b750 req-84310d0e-3dfa-4b6f-bbcc-2e797f9b8d25 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:57.995496 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-8ad1fcca-b3a0-4f1c-ad95-10932423b750 req-84310d0e-3dfa-4b6f-bbcc-2e797f9b8d25 service nova] Creating event network-changed:3756e267-a334-4ee1-9124-fa7964f67701 for instance e3facdf2-b6fd-4e91-beb1-3eda459500ff on hv-cinder-84780 Jun 27 15:56:58.002769 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-8ad1fcca-b3a0-4f1c-ad95-10932423b750 req-84310d0e-3dfa-4b6f-bbcc-2e797f9b8d25 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057892 Jun 27 15:56:58.003521 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 500/1008] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:56:58.244216 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-120c7424-3b17-475e-a0fe-7938c9cd15de tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:58.245898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-120c7424-3b17-475e-a0fe-7938c9cd15de tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:58.247619 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a049dc0f-13d3-4e0f-a78e-3f3a3ed4fb7f tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] Action: 'create', calling method: .version_select at 0x7fe14ac76550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1449576705", "metadata": {"Type": "work"}}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:56:58.257256 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-120c7424-3b17-475e-a0fe-7938c9cd15de tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:58.258048 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-120c7424-3b17-475e-a0fe-7938c9cd15de tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:58.259834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-120c7424-3b17-475e-a0fe-7938c9cd15de tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:58.260650 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-120c7424-3b17-475e-a0fe-7938c9cd15de tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a049dc0f-13d3-4e0f-a78e-3f3a3ed4fb7f tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] Request method failure captured: Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 122 Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudNJqt9kSjhkPgcWqKuQ6SsXG02nQymKIqTZnY6RwkNivVGsrEKLoDmX9PYsNc574pugoW7ZgJpCVor2zSDjndDQnOz1qDW4QFmvu4fMzAeGOReaEYwpNOaivEtSkX7g8I7zvo7T5_VYA5rkKtUTEsXcGRXnEAWyApw-UmmiBwK8vIs Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 990fc8cfabf847538fa9ff2b01932c44 Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-VolumesNegativeTest-1820909836 Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:56:58.271055 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:56:58.272698 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/990fc8cfabf847538fa9ff2b01932c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/990fc8cfabf847538fa9ff2b01932c44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/990fc8cfabf847538fa9ff2b01932c44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_990fc8cfabf847538fa9ff2b01932c44", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:56:58.272698 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-VolumesNegativeTest-1820909836 Jun 27 15:56:58.272698 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 990fc8cfabf847538fa9ff2b01932c44 Jun 27 15:56:58.272698 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-VolumesNegativeTest-1820909836 Jun 27 15:56:58.272698 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-VolumesNegativeTest-1820909836-project Jun 27 15:56:58.272698 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:56:58.272698 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:56:58.272698 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 11d2dd62463b4a709615089d3e534eb4 Jun 27 15:56:58.272698 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-VolumesNegativeTest-1820909836-project Jun 27 15:56:58.272698 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Jun 27 15:56:58.272698 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1449576705", "metadata": {"Type": "work"}}} Jun 27 15:56:58.272698 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: Jun 27 15:56:58.272698 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1449576705', 'metadata': {'Type': 'work'}}}} Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise error Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi '#$%' Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:56:58.273767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:56:58.275899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:56:58.275899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:56:58.275899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:56:58.275899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:56:58.275899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 15:56:58.275899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 15:56:58.275899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 15:56:58.275899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 15:56:58.275899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 15:56:58.275899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 15:56:58.275899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 15:56:58.275899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.275899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:58.275899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.275899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.275899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:58.275899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:58.275899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 15:56:58.275899 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 15:56:58.278273 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 15:56:58.278273 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.278273 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-a049dc0f-13d3-4e0f-a78e-3f3a3ed4fb7f tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:56:58.278273 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-a049dc0f-13d3-4e0f-a78e-3f3a3ed4fb7f tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.243946 Jun 27 15:56:58.279027 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 509/1009] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Jun 27 15:56:58 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 246 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:56:58.298558 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-580284cb-b7f4-4786-b1af-9f5b6910c2a9 tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] Action: 'create', calling method: .version_select at 0x7fe146456af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-577788050", "metadata": {"Type": "work"}}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-580284cb-b7f4-4786-b1af-9f5b6910c2a9 tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] Request method failure captured: Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 119 Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudNJqt9kSjhkPgcWqKuQ6SsXG02nQymKIqTZnY6RwkNivVGsrEKLoDmX9PYsNc574pugoW7ZgJpCVor2zSDjndDQnOz1qDW4QFmvu4fMzAeGOReaEYwpNOaivEtSkX7g8I7zvo7T5_VYA5rkKtUTEsXcGRXnEAWyApw-UmmiBwK8vIs Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 990fc8cfabf847538fa9ff2b01932c44 Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-VolumesNegativeTest-1820909836 Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:56:58.304162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:56:58.305623 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/990fc8cfabf847538fa9ff2b01932c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/990fc8cfabf847538fa9ff2b01932c44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/990fc8cfabf847538fa9ff2b01932c44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_990fc8cfabf847538fa9ff2b01932c44", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:56:58.305623 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-VolumesNegativeTest-1820909836 Jun 27 15:56:58.305623 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 990fc8cfabf847538fa9ff2b01932c44 Jun 27 15:56:58.305623 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-VolumesNegativeTest-1820909836 Jun 27 15:56:58.305623 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-VolumesNegativeTest-1820909836-project Jun 27 15:56:58.305623 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:56:58.305623 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:56:58.305623 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 11d2dd62463b4a709615089d3e534eb4 Jun 27 15:56:58.305623 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-VolumesNegativeTest-1820909836-project Jun 27 15:56:58.305623 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Jun 27 15:56:58.305623 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-577788050", "metadata": {"Type": "work"}}} Jun 27 15:56:58.305623 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: Jun 27 15:56:58.305623 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-577788050', 'metadata': {'Type': 'work'}}}} Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise error Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi '0' Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:56:58.306510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:56:58.308378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:56:58.308378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:56:58.308378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:56:58.308378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:56:58.308378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 15:56:58.308378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 15:56:58.308378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 15:56:58.308378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 15:56:58.308378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 15:56:58.308378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 15:56:58.308378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 15:56:58.308378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.308378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:58.308378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.308378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.308378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:58.308378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:58.308378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 15:56:58.308378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 15:56:58.310747 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 15:56:58.310747 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.310747 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-580284cb-b7f4-4786-b1af-9f5b6910c2a9 tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:56:58.310747 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-580284cb-b7f4-4786-b1af-9f5b6910c2a9 tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016185 Jun 27 15:56:58.310747 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 510/1010] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Jun 27 15:56:58 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 27 15:56:58.323183 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0ed5087d-d66d-46b3-b12d-a911b13e6c99 tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] Action: 'create', calling method: .version_select at 0x7fe14acf3550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1591398008", "metadata": {"Type": "work"}}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0ed5087d-d66d-46b3-b12d-a911b13e6c99 tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] Request method failure captured: Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 119 Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudNJqt9kSjhkPgcWqKuQ6SsXG02nQymKIqTZnY6RwkNivVGsrEKLoDmX9PYsNc574pugoW7ZgJpCVor2zSDjndDQnOz1qDW4QFmvu4fMzAeGOReaEYwpNOaivEtSkX7g8I7zvo7T5_VYA5rkKtUTEsXcGRXnEAWyApw-UmmiBwK8vIs Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 990fc8cfabf847538fa9ff2b01932c44 Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-VolumesNegativeTest-1820909836 Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:56:58.327903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:56:58.329444 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/990fc8cfabf847538fa9ff2b01932c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/990fc8cfabf847538fa9ff2b01932c44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/990fc8cfabf847538fa9ff2b01932c44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_990fc8cfabf847538fa9ff2b01932c44", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:56:58.329444 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-VolumesNegativeTest-1820909836 Jun 27 15:56:58.329444 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 990fc8cfabf847538fa9ff2b01932c44 Jun 27 15:56:58.329444 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-VolumesNegativeTest-1820909836 Jun 27 15:56:58.329444 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-VolumesNegativeTest-1820909836-project Jun 27 15:56:58.329444 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:56:58.329444 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:56:58.329444 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 11d2dd62463b4a709615089d3e534eb4 Jun 27 15:56:58.329444 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-VolumesNegativeTest-1820909836-project Jun 27 15:56:58.329444 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Jun 27 15:56:58.329444 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1591398008", "metadata": {"Type": "work"}}} Jun 27 15:56:58.329444 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: Jun 27 15:56:58.329444 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1591398008', 'metadata': {'Type': 'work'}}}} Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise error Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi '' Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:56:58.330587 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:56:58.332369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:56:58.332369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:56:58.332369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:56:58.332369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:56:58.332369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 15:56:58.332369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 15:56:58.332369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 15:56:58.332369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 15:56:58.332369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 15:56:58.332369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 15:56:58.332369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 15:56:58.332369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.332369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:58.332369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.332369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.332369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:58.332369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:58.332369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 15:56:58.332369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 15:56:58.333698 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 15:56:58.333698 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.333698 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-0ed5087d-d66d-46b3-b12d-a911b13e6c99 tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:56:58.333698 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-0ed5087d-d66d-46b3-b12d-a911b13e6c99 tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013508 Jun 27 15:56:58.333698 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 511/1011] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Jun 27 15:56:58 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:56:58.342785 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d48ea970-03f1-40c2-bfc5-894d2ab78d8d tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] Calling method '.version_select at 0x7fe14abf3d30>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:58.380106 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-d48ea970-03f1-40c2-bfc5-894d2ab78d8d tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] HTTP exception thrown: Volume tempest-invalid-575262891 could not be found. Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d48ea970-03f1-40c2-bfc5-894d2ab78d8d tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] Request method failure captured: Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-575262891 HTTP/1.1 Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudNJqt9kSjhkPgcWqKuQ6SsXG02nQymKIqTZnY6RwkNivVGsrEKLoDmX9PYsNc574pugoW7ZgJpCVor2zSDjndDQnOz1qDW4QFmvu4fMzAeGOReaEYwpNOaivEtSkX7g8I7zvo7T5_VYA5rkKtUTEsXcGRXnEAWyApw-UmmiBwK8vIs Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 990fc8cfabf847538fa9ff2b01932c44 Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-VolumesNegativeTest-1820909836 Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:56:58.382177 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:56:58.386036 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/990fc8cfabf847538fa9ff2b01932c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/990fc8cfabf847538fa9ff2b01932c44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/990fc8cfabf847538fa9ff2b01932c44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_990fc8cfabf847538fa9ff2b01932c44", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:56:58.386036 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-VolumesNegativeTest-1820909836 Jun 27 15:56:58.386036 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 990fc8cfabf847538fa9ff2b01932c44 Jun 27 15:56:58.386036 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-VolumesNegativeTest-1820909836 Jun 27 15:56:58.386036 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-VolumesNegativeTest-1820909836-project Jun 27 15:56:58.386036 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:56:58.386036 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:56:58.386036 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 11d2dd62463b4a709615089d3e534eb4 Jun 27 15:56:58.386036 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-VolumesNegativeTest-1820909836-project Jun 27 15:56:58.386036 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: Jun 27 15:56:58.386036 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Volume tempest-invalid-575262891 could not be found. Jun 27 15:56:58.386036 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': 'tempest-invalid-575262891'} Jun 27 15:56:58.386036 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:56:58.386888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.386888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:56:58.386888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:56:58.386888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 15:56:58.386888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 15:56:58.386888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 15:56:58.386888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 15:56:58.386888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 15:56:58.386888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 15:56:58.386888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 15:56:58.386888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 15:56:58.386888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:56:58.386888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:56:58.386888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:56:58.386888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:56:58.386888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-575262891 could not be found. (HTTP 404) (Request-ID: req-33b824b8-1285-4bf0-b12e-469346bbbbba) Jun 27 15:56:58.386888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.386888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:58.386888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.388048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.388048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 15:56:58.388048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 15:56:58.388048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:56:58.388048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:56:58.388048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:56:58.388048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:56:58.388048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:56:58.388048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:56:58.388048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:56:58.388048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:56:58.388048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 15:56:58.388048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 15:56:58.388048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 15:56:58.388048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 15:56:58.388048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 15:56:58.388048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 15:56:58.388048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 15:56:58.388048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-575262891 could not be found. Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:56:58.389176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-575262891 could not be found. Jun 27 15:56:58.390777 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.390777 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:58.390777 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.390777 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.390777 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:58.390777 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:58.390777 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:56:58.390777 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:56:58.390777 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-575262891 could not be found. Jun 27 15:56:58.390777 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.390777 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d48ea970-03f1-40c2-bfc5-894d2ab78d8d tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] Returning 404 to user: Volume tempest-invalid-575262891 could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:56:58.390777 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d48ea970-03f1-40c2-bfc5-894d2ab78d8d tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-575262891" status: 404 len: 98 microversion: 2.1 time: 0.046215 Jun 27 15:56:58.390777 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 512/1012] 10.222.0.20 () {58 vars in 1214 bytes} [Mon Jun 27 15:56:58 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-575262891 => generated 98 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 27 15:56:58.402079 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4062eaa4-8b1e-4e2b-b040-7e8740a1a817 tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006682 Jun 27 15:56:58.402666 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 513/1013] 10.222.0.20 () {58 vars in 1139 bytes} [Mon Jun 27 15:56:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 27 15:56:58.416072 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c438fa37-40d5-40d8-9f57-03471e2daa63 tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005039 Jun 27 15:56:58.418608 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 514/1014] 10.222.0.20 () {58 vars in 1136 bytes} [Mon Jun 27 15:56:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 27 15:56:58.427371 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-75a335df-83ad-4a3a-b050-2090ae4befa6 tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] Calling method '.version_select at 0x7fe14ac76af0>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:58.476142 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-75a335df-83ad-4a3a-b050-2090ae4befa6 tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] HTTP exception thrown: Volume fb899918-f5d4-4fd8-b326-a4bbc2c17ada could not be found. Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-75a335df-83ad-4a3a-b050-2090ae4befa6 tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] Request method failure captured: Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: DELETE /compute/v2.1/os-volumes/fb899918-f5d4-4fd8-b326-a4bbc2c17ada HTTP/1.1 Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudNJqt9kSjhkPgcWqKuQ6SsXG02nQymKIqTZnY6RwkNivVGsrEKLoDmX9PYsNc574pugoW7ZgJpCVor2zSDjndDQnOz1qDW4QFmvu4fMzAeGOReaEYwpNOaivEtSkX7g8I7zvo7T5_VYA5rkKtUTEsXcGRXnEAWyApw-UmmiBwK8vIs Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 990fc8cfabf847538fa9ff2b01932c44 Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-VolumesNegativeTest-1820909836 Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:56:58.478248 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:56:58.481074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/990fc8cfabf847538fa9ff2b01932c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/990fc8cfabf847538fa9ff2b01932c44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/990fc8cfabf847538fa9ff2b01932c44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_990fc8cfabf847538fa9ff2b01932c44", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:56:58.481074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-VolumesNegativeTest-1820909836 Jun 27 15:56:58.481074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 990fc8cfabf847538fa9ff2b01932c44 Jun 27 15:56:58.481074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-VolumesNegativeTest-1820909836 Jun 27 15:56:58.481074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-VolumesNegativeTest-1820909836-project Jun 27 15:56:58.481074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:56:58.481074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:56:58.481074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 11d2dd62463b4a709615089d3e534eb4 Jun 27 15:56:58.481074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-VolumesNegativeTest-1820909836-project Jun 27 15:56:58.481074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: Jun 27 15:56:58.481074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Volume fb899918-f5d4-4fd8-b326-a4bbc2c17ada could not be found. Jun 27 15:56:58.481074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': 'fb899918-f5d4-4fd8-b326-a4bbc2c17ada'} Jun 27 15:56:58.481074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:56:58.483733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.483733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:56:58.483733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:56:58.483733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 15:56:58.483733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 15:56:58.483733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 15:56:58.483733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 15:56:58.483733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 15:56:58.483733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 15:56:58.483733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 15:56:58.483733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 15:56:58.483733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:56:58.483733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:56:58.483733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:56:58.483733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:56:58.483733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb899918-f5d4-4fd8-b326-a4bbc2c17ada could not be found. (HTTP 404) (Request-ID: req-de77a9d6-fa64-4d21-bd9b-01feb9613da7) Jun 27 15:56:58.483733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.483733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:58.483733 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.487750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.487750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 15:56:58.487750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 15:56:58.487750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:56:58.487750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:56:58.487750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:56:58.487750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:56:58.487750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:56:58.487750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:56:58.487750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:56:58.487750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:56:58.487750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 15:56:58.487750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 15:56:58.487750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 15:56:58.487750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 15:56:58.487750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 15:56:58.487750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 15:56:58.487750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 15:56:58.487750 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 15:56:58.492042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:56:58.492042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:56:58.492042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:56:58.492042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:56:58.492042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb899918-f5d4-4fd8-b326-a4bbc2c17ada could not be found. Jun 27 15:56:58.492042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.492042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:58.492042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.492042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.492042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:58.492042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:58.492042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:56:58.492042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:56:58.492042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:56:58.492042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:56:58.492042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:56:58.492042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:56:58.492042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 15:56:58.492042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:56:58.494707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb899918-f5d4-4fd8-b326-a4bbc2c17ada could not be found. Jun 27 15:56:58.494707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.494707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:58.494707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.494707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.494707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:58.494707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:58.494707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:56:58.494707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:56:58.494707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb899918-f5d4-4fd8-b326-a4bbc2c17ada could not be found. Jun 27 15:56:58.494707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.494707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-75a335df-83ad-4a3a-b050-2090ae4befa6 tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] Returning 404 to user: Volume fb899918-f5d4-4fd8-b326-a4bbc2c17ada could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:56:58.494707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-75a335df-83ad-4a3a-b050-2090ae4befa6 tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/fb899918-f5d4-4fd8-b326-a4bbc2c17ada" status: 404 len: 109 microversion: 2.1 time: 0.058936 Jun 27 15:56:58.494707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 515/1015] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 27 15:56:58 2022] DELETE /compute/v2.1/os-volumes/fb899918-f5d4-4fd8-b326-a4bbc2c17ada => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:56:58.497584 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4dfcade8-92fc-4838-9c64-71e6647535fb tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] Calling method '.version_select at 0x7fe1464894c0>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:58.502587 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-120c7424-3b17-475e-a0fe-7938c9cd15de tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:58.519185 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-120c7424-3b17-475e-a0fe-7938c9cd15de tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff" status: 200 len: 1367 microversion: 2.1 time: 0.282427 Jun 27 15:56:58.520739 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 501/1016] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:58 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:56:58.531416 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-4dfcade8-92fc-4838-9c64-71e6647535fb tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] HTTP exception thrown: Volume 4914fd7c-83d3-4314-bfd2-220ea5941fd7 could not be found. Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4dfcade8-92fc-4838-9c64-71e6647535fb tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] Request method failure captured: Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: GET /compute/v2.1/os-volumes/4914fd7c-83d3-4314-bfd2-220ea5941fd7 HTTP/1.1 Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudNJqt9kSjhkPgcWqKuQ6SsXG02nQymKIqTZnY6RwkNivVGsrEKLoDmX9PYsNc574pugoW7ZgJpCVor2zSDjndDQnOz1qDW4QFmvu4fMzAeGOReaEYwpNOaivEtSkX7g8I7zvo7T5_VYA5rkKtUTEsXcGRXnEAWyApw-UmmiBwK8vIs Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 990fc8cfabf847538fa9ff2b01932c44 Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-VolumesNegativeTest-1820909836 Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:56:58.536794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:56:58.538976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/990fc8cfabf847538fa9ff2b01932c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/990fc8cfabf847538fa9ff2b01932c44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/990fc8cfabf847538fa9ff2b01932c44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_990fc8cfabf847538fa9ff2b01932c44", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:56:58.538976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-VolumesNegativeTest-1820909836 Jun 27 15:56:58.538976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 990fc8cfabf847538fa9ff2b01932c44 Jun 27 15:56:58.538976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-VolumesNegativeTest-1820909836 Jun 27 15:56:58.538976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-VolumesNegativeTest-1820909836-project Jun 27 15:56:58.538976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:56:58.538976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:56:58.538976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 11d2dd62463b4a709615089d3e534eb4 Jun 27 15:56:58.538976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-VolumesNegativeTest-1820909836-project Jun 27 15:56:58.538976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: Jun 27 15:56:58.538976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Volume 4914fd7c-83d3-4314-bfd2-220ea5941fd7 could not be found. Jun 27 15:56:58.538976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': '4914fd7c-83d3-4314-bfd2-220ea5941fd7'} Jun 27 15:56:58.538976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:56:58.539797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.539797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:56:58.539797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:56:58.539797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:56:58.539797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:56:58.539797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:56:58.539797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:56:58.539797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:56:58.539797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:56:58.539797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:56:58.539797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:56:58.539797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:56:58.539797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:56:58.539797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:56:58.539797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:56:58.539797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4914fd7c-83d3-4314-bfd2-220ea5941fd7 could not be found. (HTTP 404) (Request-ID: req-8624cc6d-19e9-45af-bcd5-0f110ab22efe) Jun 27 15:56:58.539797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.539797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:58.539797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.540986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.540986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 15:56:58.540986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 15:56:58.540986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:56:58.540986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:56:58.540986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:56:58.540986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:56:58.540986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:56:58.540986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:56:58.540986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:56:58.540986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:56:58.540986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:56:58.540986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:56:58.540986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:56:58.540986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:56:58.540986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:56:58.540986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:56:58.540986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:56:58.540986 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:56:58.542919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:56:58.542919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:56:58.542919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:56:58.542919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:56:58.542919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4914fd7c-83d3-4314-bfd2-220ea5941fd7 could not be found. Jun 27 15:56:58.542919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.542919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:58.542919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.542919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.542919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:58.542919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:58.542919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:56:58.542919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:56:58.542919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:56:58.542919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:56:58.542919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:56:58.542919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:56:58.542919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 15:56:58.542919 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:56:58.544776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4914fd7c-83d3-4314-bfd2-220ea5941fd7 could not be found. Jun 27 15:56:58.544776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.544776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:56:58.544776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.544776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:56:58.544776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:56:58.544776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:56:58.544776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:56:58.544776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:56:58.544776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4914fd7c-83d3-4314-bfd2-220ea5941fd7 could not be found. Jun 27 15:56:58.544776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:56:58.544776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4dfcade8-92fc-4838-9c64-71e6647535fb tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] Returning 404 to user: Volume 4914fd7c-83d3-4314-bfd2-220ea5941fd7 could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:56:58.544776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4dfcade8-92fc-4838-9c64-71e6647535fb tempest-VolumesNegativeTest-1820909836 tempest-VolumesNegativeTest-1820909836-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/4914fd7c-83d3-4314-bfd2-220ea5941fd7" status: 404 len: 109 microversion: 2.1 time: 0.052807 Jun 27 15:56:58.544776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 516/1017] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jun 27 15:56:58 2022] GET /compute/v2.1/os-volumes/4914fd7c-83d3-4314-bfd2-220ea5941fd7 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:56:59.539957 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-35d637d4-5342-4a25-b69c-5831cd07a7cf tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:56:59.540662 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-35d637d4-5342-4a25-b69c-5831cd07a7cf tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:56:59.550090 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-35d637d4-5342-4a25-b69c-5831cd07a7cf tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:59.550625 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-35d637d4-5342-4a25-b69c-5831cd07a7cf tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:59.551600 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-35d637d4-5342-4a25-b69c-5831cd07a7cf tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:56:59.552122 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-35d637d4-5342-4a25-b69c-5831cd07a7cf tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:56:59.720616 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-35d637d4-5342-4a25-b69c-5831cd07a7cf tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:56:59.731993 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-35d637d4-5342-4a25-b69c-5831cd07a7cf tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff" status: 200 len: 1367 microversion: 2.1 time: 0.197833 Jun 27 15:56:59.732947 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 502/1018] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:56:59 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:57:00.757458 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-02b28ec5-36d6-4abc-8d2e-bcfa476a975a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:57:00.759057 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-02b28ec5-36d6-4abc-8d2e-bcfa476a975a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:57:00.768405 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-02b28ec5-36d6-4abc-8d2e-bcfa476a975a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:00.769376 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-02b28ec5-36d6-4abc-8d2e-bcfa476a975a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:00.771676 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-02b28ec5-36d6-4abc-8d2e-bcfa476a975a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:00.772335 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-02b28ec5-36d6-4abc-8d2e-bcfa476a975a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:00.944828 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-02b28ec5-36d6-4abc-8d2e-bcfa476a975a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:57:00.958231 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-02b28ec5-36d6-4abc-8d2e-bcfa476a975a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff" status: 200 len: 1367 microversion: 2.1 time: 0.207684 Jun 27 15:57:00.959189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 517/1019] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:57:00 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:57:01.983414 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8a8b67ea-c517-42ac-81d7-c5fb783da4e7 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:57:01.984175 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-8a8b67ea-c517-42ac-81d7-c5fb783da4e7 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:57:01.993234 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8a8b67ea-c517-42ac-81d7-c5fb783da4e7 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:01.993878 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8a8b67ea-c517-42ac-81d7-c5fb783da4e7 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:01.994842 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8a8b67ea-c517-42ac-81d7-c5fb783da4e7 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:01.995436 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-8a8b67ea-c517-42ac-81d7-c5fb783da4e7 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:02.174416 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-8a8b67ea-c517-42ac-81d7-c5fb783da4e7 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:57:02.184941 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-8a8b67ea-c517-42ac-81d7-c5fb783da4e7 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff" status: 200 len: 1367 microversion: 2.1 time: 0.205670 Jun 27 15:57:02.185793 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 503/1020] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:57:01 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:57:03.205134 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-65360e37-3110-4219-a5ec-e575d9b20ea8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:57:03.205755 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-65360e37-3110-4219-a5ec-e575d9b20ea8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:57:03.213765 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-65360e37-3110-4219-a5ec-e575d9b20ea8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:03.214212 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-65360e37-3110-4219-a5ec-e575d9b20ea8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:03.215007 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-65360e37-3110-4219-a5ec-e575d9b20ea8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:03.215448 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-65360e37-3110-4219-a5ec-e575d9b20ea8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:03.392959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-65360e37-3110-4219-a5ec-e575d9b20ea8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:57:03.402018 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-65360e37-3110-4219-a5ec-e575d9b20ea8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff" status: 200 len: 1367 microversion: 2.1 time: 0.200912 Jun 27 15:57:03.402605 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 518/1021] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:57:03 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:57:04.427243 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-18e0e4a3-0349-4c66-8859-bd4b3e0dd3cb tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:57:04.427955 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-18e0e4a3-0349-4c66-8859-bd4b3e0dd3cb tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:57:04.435657 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-18e0e4a3-0349-4c66-8859-bd4b3e0dd3cb tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:04.436159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-18e0e4a3-0349-4c66-8859-bd4b3e0dd3cb tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:04.437148 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-18e0e4a3-0349-4c66-8859-bd4b3e0dd3cb tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:04.437732 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-18e0e4a3-0349-4c66-8859-bd4b3e0dd3cb tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:04.596320 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-18e0e4a3-0349-4c66-8859-bd4b3e0dd3cb tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:57:04.605040 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-18e0e4a3-0349-4c66-8859-bd4b3e0dd3cb tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff" status: 200 len: 1367 microversion: 2.1 time: 0.182019 Jun 27 15:57:04.605671 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 504/1022] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:57:04 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:57:05.632590 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-69329ba6-fadf-48da-9869-e5cabf657525 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:57:05.633205 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-69329ba6-fadf-48da-9869-e5cabf657525 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:57:05.635829 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=2 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:57:05.636528 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=6 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:57:05.643572 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-69329ba6-fadf-48da-9869-e5cabf657525 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:05.644019 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-69329ba6-fadf-48da-9869-e5cabf657525 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:05.644906 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-69329ba6-fadf-48da-9869-e5cabf657525 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:05.646342 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-69329ba6-fadf-48da-9869-e5cabf657525 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:05.797020 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-69329ba6-fadf-48da-9869-e5cabf657525 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:57:05.810228 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-69329ba6-fadf-48da-9869-e5cabf657525 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff" status: 200 len: 1367 microversion: 2.1 time: 0.182343 Jun 27 15:57:05.810975 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 519/1023] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:57:05 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:57:06.290098 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-5ecb4e10-cf11-46fd-9007-38809dc8495f req-def34b69-c017-4f5d-802c-0a043d8cb2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3facdf2-b6fd-4e91-beb1-3eda459500ff", "name": "network-vif-plugged", "status": "completed", "tag": "3756e267-a334-4ee1-9124-fa7964f67701"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:57:06.298584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=6 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:57:06.305598 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-5ecb4e10-cf11-46fd-9007-38809dc8495f req-def34b69-c017-4f5d-802c-0a043d8cb2e4 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:06.306128 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-5ecb4e10-cf11-46fd-9007-38809dc8495f req-def34b69-c017-4f5d-802c-0a043d8cb2e4 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:06.320579 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-5ecb4e10-cf11-46fd-9007-38809dc8495f req-def34b69-c017-4f5d-802c-0a043d8cb2e4 service nova] Creating event network-vif-plugged:3756e267-a334-4ee1-9124-fa7964f67701 for instance e3facdf2-b6fd-4e91-beb1-3eda459500ff on hv-cinder-84780 Jun 27 15:57:06.326337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-5ecb4e10-cf11-46fd-9007-38809dc8495f req-def34b69-c017-4f5d-802c-0a043d8cb2e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040586 Jun 27 15:57:06.326960 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 505/1024] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:57:06.829984 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-6a74e68e-5a7b-4c68-adc3-adc035128a7a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:57:06.830744 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-6a74e68e-5a7b-4c68-adc3-adc035128a7a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:57:06.839048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6a74e68e-5a7b-4c68-adc3-adc035128a7a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:06.839504 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6a74e68e-5a7b-4c68-adc3-adc035128a7a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:06.840294 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6a74e68e-5a7b-4c68-adc3-adc035128a7a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:06.840731 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6a74e68e-5a7b-4c68-adc3-adc035128a7a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:06.995933 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-6a74e68e-5a7b-4c68-adc3-adc035128a7a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:57:07.004402 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-6a74e68e-5a7b-4c68-adc3-adc035128a7a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff" status: 200 len: 1367 microversion: 2.1 time: 0.179063 Jun 27 15:57:07.005217 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 520/1025] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:57:06 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:57:08.024685 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-2b0b5aa9-5271-4cc5-b60c-8bfdf12d6524 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:57:08.025308 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-2b0b5aa9-5271-4cc5-b60c-8bfdf12d6524 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:57:08.027601 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:57:08.033920 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2b0b5aa9-5271-4cc5-b60c-8bfdf12d6524 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:08.034372 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2b0b5aa9-5271-4cc5-b60c-8bfdf12d6524 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:08.035157 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2b0b5aa9-5271-4cc5-b60c-8bfdf12d6524 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:08.036254 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2b0b5aa9-5271-4cc5-b60c-8bfdf12d6524 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:08.040702 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:57:08.237382 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-2b0b5aa9-5271-4cc5-b60c-8bfdf12d6524 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:57:08.251245 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-2b0b5aa9-5271-4cc5-b60c-8bfdf12d6524 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff" status: 200 len: 1556 microversion: 2.1 time: 0.231517 Jun 27 15:57:08.252259 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 506/1026] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:57:08 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff => generated 1556 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:57:08.274421 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-937469fd-3605-4533-924a-07de8f4ddbe3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:57:08.275394 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-937469fd-3605-4533-924a-07de8f4ddbe3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:57:08.287599 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-937469fd-3605-4533-924a-07de8f4ddbe3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:08.288393 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-937469fd-3605-4533-924a-07de8f4ddbe3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:08.289865 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-937469fd-3605-4533-924a-07de8f4ddbe3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:08.290651 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-937469fd-3605-4533-924a-07de8f4ddbe3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:08.319064 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:57:08.411139 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-937469fd-3605-4533-924a-07de8f4ddbe3 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144071 Jun 27 15:57:08.417886 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 521/1027] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jun 27 15:57:08 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:57:10.386131 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-45bb3511-c70d-4b80-afd0-762cc267a025 req-08d54cf4-6b38-4c04-b96a-160eb0df1075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3facdf2-b6fd-4e91-beb1-3eda459500ff", "tag": "3756e267-a334-4ee1-9124-fa7964f67701"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:57:10.401604 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-45bb3511-c70d-4b80-afd0-762cc267a025 req-08d54cf4-6b38-4c04-b96a-160eb0df1075 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:10.402288 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-45bb3511-c70d-4b80-afd0-762cc267a025 req-08d54cf4-6b38-4c04-b96a-160eb0df1075 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:10.425239 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-45bb3511-c70d-4b80-afd0-762cc267a025 req-08d54cf4-6b38-4c04-b96a-160eb0df1075 service nova] Creating event network-changed:3756e267-a334-4ee1-9124-fa7964f67701 for instance e3facdf2-b6fd-4e91-beb1-3eda459500ff on hv-cinder-84780 Jun 27 15:57:10.435352 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-45bb3511-c70d-4b80-afd0-762cc267a025 req-08d54cf4-6b38-4c04-b96a-160eb0df1075 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055601 Jun 27 15:57:10.436531 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 507/1028] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:57:42.856585 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:57:42.857334 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:57:42.861991 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-25ced1a3-19f4-4d37-b06f-9c2eabd4c4de tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:57:42.862644 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-25ced1a3-19f4-4d37-b06f-9c2eabd4c4de tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:57:42.870490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-25ced1a3-19f4-4d37-b06f-9c2eabd4c4de tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:42.870950 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-25ced1a3-19f4-4d37-b06f-9c2eabd4c4de tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:42.871763 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-25ced1a3-19f4-4d37-b06f-9c2eabd4c4de tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:42.872200 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-25ced1a3-19f4-4d37-b06f-9c2eabd4c4de tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:42.902498 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-25ced1a3-19f4-4d37-b06f-9c2eabd4c4de tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff/ips" status: 200 len: 149 microversion: 2.1 time: 0.047525 Jun 27 15:57:42.903101 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 522/1029] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 27 15:57:42 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:57:44.309672 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=3 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:57:44.310965 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=7 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:57:44.319153 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-522609f1-80b1-4fbd-b44b-a350e14747ef tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e754c0c-cee1-4730-84c5-4ae1a034047f"}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:57:44.321271 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-522609f1-80b1-4fbd-b44b-a350e14747ef tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:57:44.334794 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-522609f1-80b1-4fbd-b44b-a350e14747ef tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:44.335506 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-522609f1-80b1-4fbd-b44b-a350e14747ef tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:44.336816 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-522609f1-80b1-4fbd-b44b-a350e14747ef tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:44.337586 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-522609f1-80b1-4fbd-b44b-a350e14747ef tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:44.679827 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-522609f1-80b1-4fbd-b44b-a350e14747ef tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "POST /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.373063 Jun 27 15:57:44.680485 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 508/1030] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 27 15:57:44 2022] POST /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff/os-volume_attachments => generated 194 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:57:52.291679 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-75057233-755f-4d47-8e68-585c03fe2f8b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e754c0c-cee1-4730-84c5-4ae1a034047f"}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:57:52.292844 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-75057233-755f-4d47-8e68-585c03fe2f8b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:57:52.302701 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-75057233-755f-4d47-8e68-585c03fe2f8b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:52.303534 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-75057233-755f-4d47-8e68-585c03fe2f8b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:52.304900 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-75057233-755f-4d47-8e68-585c03fe2f8b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:52.305716 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-75057233-755f-4d47-8e68-585c03fe2f8b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:52.416744 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-75057233-755f-4d47-8e68-585c03fe2f8b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] HTTP exception thrown: Invalid volume: volume 1e754c0c-cee1-4730-84c5-4ae1a034047f is already attached to instances: e3facdf2-b6fd-4e91-beb1-3eda459500ff Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-75057233-755f-4d47-8e68-585c03fe2f8b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Request method failure captured: Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: POST /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff/os-volume_attachments HTTP/1.1 Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 74 Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudKgwhUwXfk48AzZs0c5fmwwnDHGCcKPSCxkN5S5OSVIy6LsaEhk8pkOYw3Gba3WVv-Fl8yJFTEFhTCQMs2rJ8pHCHlMqrvqMWGswWTUzgomFdKB0h_BYFAabKkpg_N6pl3W9_BhGboKe81vFI9AcJFLfEjyn2HlzbkDBAwN4ZsQghM Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:57:52.418641 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:57:52.421366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_90d9fb4d2e024e6eac7eeee72e63e904", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:57:52.421366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:57:52.421366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:57:52.421366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:57:52.421366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:57:52.421366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:57:52.421366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:57:52.421366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: ce59e0072f1c4b91a2825e5fecde7e23 Jun 27 15:57:52.421366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:57:52.421366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Jun 27 15:57:52.421366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {"volumeAttachment": {"volumeId": "1e754c0c-cee1-4730-84c5-4ae1a034047f"}} Jun 27 15:57:52.421366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:57:52.423153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Invalid volume: volume 1e754c0c-cee1-4730-84c5-4ae1a034047f is already attached to instances: e3facdf2-b6fd-4e91-beb1-3eda459500ff Jun 27 15:57:52.423153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'server_id': 'e3facdf2-b6fd-4e91-beb1-3eda459500ff', 'body': {'volumeAttachment': {'volumeId': '1e754c0c-cee1-4730-84c5-4ae1a034047f'}}} Jun 27 15:57:52.423153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:57:52.423153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:57:52.423153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 15:57:52.423153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 15:57:52.423153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 15:57:52.423153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 15:57:52.423153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 27 15:57:52.423153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 27 15:57:52.423153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 27 15:57:52.423153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 27 15:57:52.423153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 27 15:57:52.423153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 27 15:57:52.423153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1e754c0c-cee1-4730-84c5-4ae1a034047f is already attached to instances: e3facdf2-b6fd-4e91-beb1-3eda459500ff Jun 27 15:57:52.423153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:57:52.423153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:57:52.423153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:57:52.423153 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1e754c0c-cee1-4730-84c5-4ae1a034047f is already attached to instances: e3facdf2-b6fd-4e91-beb1-3eda459500ff Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:57:52.427187 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:57:52.429542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:57:52.429542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:57:52.429542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:57:52.429542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1e754c0c-cee1-4730-84c5-4ae1a034047f is already attached to instances: e3facdf2-b6fd-4e91-beb1-3eda459500ff Jun 27 15:57:52.429542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:57:52.429542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-75057233-755f-4d47-8e68-585c03fe2f8b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Returning 400 to user: Invalid volume: volume 1e754c0c-cee1-4730-84c5-4ae1a034047f is already attached to instances: e3facdf2-b6fd-4e91-beb1-3eda459500ff {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:57:52.429542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-75057233-755f-4d47-8e68-585c03fe2f8b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "POST /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.132701 Jun 27 15:57:52.429542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 523/1031] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 27 15:57:52 2022] POST /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff/os-volume_attachments => generated 174 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:57:52.493659 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-17dab516-a87c-48f1-8f1d-03e38775eb00 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:57:52.494400 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-17dab516-a87c-48f1-8f1d-03e38775eb00 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:57:52.501670 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-17dab516-a87c-48f1-8f1d-03e38775eb00 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:52.502176 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-17dab516-a87c-48f1-8f1d-03e38775eb00 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:52.503422 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-17dab516-a87c-48f1-8f1d-03e38775eb00 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:52.504193 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-17dab516-a87c-48f1-8f1d-03e38775eb00 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:52.603033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-17dab516-a87c-48f1-8f1d-03e38775eb00 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lazy-loading 'services' on Instance uuid e3facdf2-b6fd-4e91-beb1-3eda459500ff {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:57:52.685410 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-17dab516-a87c-48f1-8f1d-03e38775eb00 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff/os-volume_attachments/1e754c0c-cee1-4730-84c5-4ae1a034047f" status: 202 len: 0 microversion: 2.1 time: 0.196766 Jun 27 15:57:52.686405 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 509/1032] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 27 15:57:52 2022] DELETE /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff/os-volume_attachments/1e754c0c-cee1-4730-84c5-4ae1a034047f => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:57:52.696586 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4b8c4386-59e1-431d-b5aa-4f22d9dbee80 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:57:52.697601 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-4b8c4386-59e1-431d-b5aa-4f22d9dbee80 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:57:52.705052 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4b8c4386-59e1-431d-b5aa-4f22d9dbee80 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:52.705495 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4b8c4386-59e1-431d-b5aa-4f22d9dbee80 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:52.707136 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4b8c4386-59e1-431d-b5aa-4f22d9dbee80 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:52.707561 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4b8c4386-59e1-431d-b5aa-4f22d9dbee80 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:52.750962 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4b8c4386-59e1-431d-b5aa-4f22d9dbee80 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058426 Jun 27 15:57:52.752018 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 524/1033] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 27 15:57:52 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:57:53.768302 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-1a21724c-f27a-429e-be2a-e81408a492cd tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:57:53.770725 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-1a21724c-f27a-429e-be2a-e81408a492cd tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:57:53.777493 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1a21724c-f27a-429e-be2a-e81408a492cd tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:53.777971 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1a21724c-f27a-429e-be2a-e81408a492cd tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:53.778754 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1a21724c-f27a-429e-be2a-e81408a492cd tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:53.779187 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1a21724c-f27a-429e-be2a-e81408a492cd tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:53.816294 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-1a21724c-f27a-429e-be2a-e81408a492cd tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052550 Jun 27 15:57:53.816895 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 510/1034] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 27 15:57:53 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 15:57:53.885113 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-2d25eac2-dcb6-47b7-899c-5c649bdc979f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:57:53.885768 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-2d25eac2-dcb6-47b7-899c-5c649bdc979f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:57:53.894217 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2d25eac2-dcb6-47b7-899c-5c649bdc979f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:53.895588 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2d25eac2-dcb6-47b7-899c-5c649bdc979f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:53.896820 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2d25eac2-dcb6-47b7-899c-5c649bdc979f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:53.897503 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2d25eac2-dcb6-47b7-899c-5c649bdc979f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:53.944280 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-2d25eac2-dcb6-47b7-899c-5c649bdc979f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Going to try to terminate instance {{(pid=129473) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:57:54.082175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-2d25eac2-dcb6-47b7-899c-5c649bdc979f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff" status: 204 len: 0 microversion: 2.1 time: 0.200956 Jun 27 15:57:54.082776 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 525/1035] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:57:53 2022] DELETE /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:57:54.092913 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9597cb27-818a-4b45-be3e-1815bbbbf04b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:57:54.093545 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9597cb27-818a-4b45-be3e-1815bbbbf04b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:57:54.100594 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9597cb27-818a-4b45-be3e-1815bbbbf04b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:54.101084 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9597cb27-818a-4b45-be3e-1815bbbbf04b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:54.102011 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9597cb27-818a-4b45-be3e-1815bbbbf04b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:54.102450 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9597cb27-818a-4b45-be3e-1815bbbbf04b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:54.266840 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9597cb27-818a-4b45-be3e-1815bbbbf04b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:57:54.276498 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9597cb27-818a-4b45-be3e-1815bbbbf04b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff" status: 200 len: 1681 microversion: 2.1 time: 0.188748 Jun 27 15:57:54.277085 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 511/1036] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:57:54 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:57:55.295622 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ceafb39c-3286-457a-8c13-e56bc4a7fe03 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:57:55.296413 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-ceafb39c-3286-457a-8c13-e56bc4a7fe03 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:57:55.304349 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ceafb39c-3286-457a-8c13-e56bc4a7fe03 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:55.304889 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ceafb39c-3286-457a-8c13-e56bc4a7fe03 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:55.305756 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ceafb39c-3286-457a-8c13-e56bc4a7fe03 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:55.306197 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ceafb39c-3286-457a-8c13-e56bc4a7fe03 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:55.455668 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-ceafb39c-3286-457a-8c13-e56bc4a7fe03 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:57:55.470129 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-ceafb39c-3286-457a-8c13-e56bc4a7fe03 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff" status: 200 len: 1681 microversion: 2.1 time: 0.178952 Jun 27 15:57:55.471164 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 526/1037] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:57:55 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:57:56.492188 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-81d58f4c-1429-47f7-a453-7fd80937110f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:57:56.493114 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-81d58f4c-1429-47f7-a453-7fd80937110f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:57:56.505548 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81d58f4c-1429-47f7-a453-7fd80937110f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:56.506365 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81d58f4c-1429-47f7-a453-7fd80937110f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:56.507752 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81d58f4c-1429-47f7-a453-7fd80937110f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:56.508527 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-81d58f4c-1429-47f7-a453-7fd80937110f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:56.618519 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-81d58f4c-1429-47f7-a453-7fd80937110f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:57:56.627604 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-81d58f4c-1429-47f7-a453-7fd80937110f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff" status: 200 len: 1613 microversion: 2.1 time: 0.142387 Jun 27 15:57:56.629018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 512/1038] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:57:56 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff => generated 1613 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:57:56.731721 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-1b62c316-d49d-46a1-a380-70c87b52fb70 req-11ed5c21-83d3-488d-aa80-c767d537e2dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3facdf2-b6fd-4e91-beb1-3eda459500ff", "name": "network-vif-deleted", "tag": "3756e267-a334-4ee1-9124-fa7964f67701"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:57:56.751336 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-1b62c316-d49d-46a1-a380-70c87b52fb70 req-11ed5c21-83d3-488d-aa80-c767d537e2dc service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:56.752552 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-1b62c316-d49d-46a1-a380-70c87b52fb70 req-11ed5c21-83d3-488d-aa80-c767d537e2dc service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:56.775585 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-1b62c316-d49d-46a1-a380-70c87b52fb70 req-11ed5c21-83d3-488d-aa80-c767d537e2dc service nova] Creating event network-vif-deleted:3756e267-a334-4ee1-9124-fa7964f67701 for instance e3facdf2-b6fd-4e91-beb1-3eda459500ff on hv-cinder-84780 Jun 27 15:57:56.786238 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-1b62c316-d49d-46a1-a380-70c87b52fb70 req-11ed5c21-83d3-488d-aa80-c767d537e2dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061767 Jun 27 15:57:56.787271 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 527/1039] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:57:57.656017 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3edd4915-62e9-461d-a9cb-b35d4ba392f4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:57:57.656746 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3edd4915-62e9-461d-a9cb-b35d4ba392f4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:57:57.664891 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3edd4915-62e9-461d-a9cb-b35d4ba392f4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:57.665338 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3edd4915-62e9-461d-a9cb-b35d4ba392f4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:57.666172 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3edd4915-62e9-461d-a9cb-b35d4ba392f4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:57:57.666616 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3edd4915-62e9-461d-a9cb-b35d4ba392f4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:57:57.683162 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-3edd4915-62e9-461d-a9cb-b35d4ba392f4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] HTTP exception thrown: Instance e3facdf2-b6fd-4e91-beb1-3eda459500ff could not be found. Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3edd4915-62e9-461d-a9cb-b35d4ba392f4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Request method failure captured: Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff HTTP/1.1 Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudKgwhUwXfk48AzZs0c5fmwwnDHGCcKPSCxkN5S5OSVIy6LsaEhk8pkOYw3Gba3WVv-Fl8yJFTEFhTCQMs2rJ8pHCHlMqrvqMWGswWTUzgomFdKB0h_BYFAabKkpg_N6pl3W9_BhGboKe81vFI9AcJFLfEjyn2HlzbkDBAwN4ZsQghM Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:57:57.684898 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:57:57.687621 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_90d9fb4d2e024e6eac7eeee72e63e904", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:57:57.687621 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:57:57.687621 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:57:57.687621 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:57:57.687621 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:57:57.687621 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:57:57.687621 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:57:57.687621 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: ce59e0072f1c4b91a2825e5fecde7e23 Jun 27 15:57:57.687621 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:57:57.687621 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:57:57.687621 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance e3facdf2-b6fd-4e91-beb1-3eda459500ff could not be found. Jun 27 15:57:57.687621 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': 'e3facdf2-b6fd-4e91-beb1-3eda459500ff'} Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3facdf2-b6fd-4e91-beb1-3eda459500ff could not be found. Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:57:57.691033 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:57:57.693885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:57:57.693885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:57:57.693885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:57:57.693885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:57:57.693885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:57:57.693885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:57:57.693885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:57:57.693885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3facdf2-b6fd-4e91-beb1-3eda459500ff could not be found. Jun 27 15:57:57.693885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:57:57.693885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:57:57.693885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:57:57.693885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:57:57.693885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:57:57.693885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:57:57.693885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:57:57.693885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:57:57.693885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3facdf2-b6fd-4e91-beb1-3eda459500ff could not be found. Jun 27 15:57:57.693885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:57:57.697057 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3edd4915-62e9-461d-a9cb-b35d4ba392f4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Returning 404 to user: Instance e3facdf2-b6fd-4e91-beb1-3eda459500ff could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:57:57.697057 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3edd4915-62e9-461d-a9cb-b35d4ba392f4 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff" status: 404 len: 111 microversion: 2.1 time: 0.034428 Jun 27 15:57:57.697057 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 513/1040] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:57:57 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:57:57.702204 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-38026d28-0fb8-40c8-995b-c2a46d8127d2 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '.version_select at 0x7fe14acf34c0>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:57:57.733197 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-38026d28-0fb8-40c8-995b-c2a46d8127d2 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-825078713" status: 202 len: 0 microversion: 2.1 time: 0.038099 Jun 27 15:57:57.734453 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 528/1041] 10.222.0.20 () {58 vars in 1217 bytes} [Mon Jun 27 15:57:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-825078713 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:57:58.585477 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-8885011f-d4cc-4c55-b3de-067813579cc8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Action: 'create', calling method: .version_select at 0x7fe145c09e50>, body: {"keypair": {"name": "tempest-keypair-1867998651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXgpB0lh/v78qrGLgFMqWDYJO8B6K7+XPwCSDK8T5n5Mm2BvzhURP6Abzsu6jIMTxk0jGYMZKZ8gfPmiNKGG6wPM8AOufjFcN6zn9h6W9x1lFYNrSsVenOoWIzEWi/1dA=="}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:57:58.601764 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-8885011f-d4cc-4c55-b3de-067813579cc8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Getting quotas for project 90d9fb4d2e024e6eac7eeee72e63e904. Resources: {'key_pairs'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:57:58.606789 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-8885011f-d4cc-4c55-b3de-067813579cc8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Getting quotas for user ce59e0072f1c4b91a2825e5fecde7e23 and project 90d9fb4d2e024e6eac7eeee72e63e904. Resources: {'key_pairs'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:57:58.634940 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-8885011f-d4cc-4c55-b3de-067813579cc8 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054039 Jun 27 15:57:58.635556 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 514/1042] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 27 15:57:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:58:00.352894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-cef87079-2506-4494-8d46-5d33c514b6ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-626638256", "imageRef": "11f9be98-90d6-4c67-8d66-0b944f5a2a2b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db23eeee-31f0-406e-a989-356a481d9808"}], "security_groups": [{"name": "tempest-securitygroup--946165787"}], "key_name": "tempest-keypair-1867998651", "user_data": "}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:58:00.713033 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.network.neutron [None req-cef87079-2506-4494-8d46-5d33c514b6ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] validate_networks() for [('db23eeee-31f0-406e-a989-356a481d9808', None, None, None, None, None)] {{(pid=129473) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:58:01.196367 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-cef87079-2506-4494-8d46-5d33c514b6ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Flavor limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:58:01.196877 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-cef87079-2506-4494-8d46-5d33c514b6ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Image limits 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:58:01.197749 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-cef87079-2506-4494-8d46-5d33c514b6ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Flavor pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:58:01.198278 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-cef87079-2506-4494-8d46-5d33c514b6ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Image pref 0:0:0 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:58:01.198890 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.virt.hardware [None req-cef87079-2506-4494-8d46-5d33c514b6ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:58:01.210516 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cef87079-2506-4494-8d46-5d33c514b6ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:01.210954 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cef87079-2506-4494-8d46-5d33c514b6ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:01.211809 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cef87079-2506-4494-8d46-5d33c514b6ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:01.212204 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-cef87079-2506-4494-8d46-5d33c514b6ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:01.232446 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-cef87079-2506-4494-8d46-5d33c514b6ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Getting quotas for project 90d9fb4d2e024e6eac7eeee72e63e904. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:58:01.237146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-cef87079-2506-4494-8d46-5d33c514b6ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Getting quotas for user ce59e0072f1c4b91a2825e5fecde7e23 and project 90d9fb4d2e024e6eac7eeee72e63e904. Resources: {'ram', 'cores', 'instances'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:58:01.250366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-cef87079-2506-4494-8d46-5d33c514b6ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Going to run 1 instances... {{(pid=129473) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:58:01.253389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-cef87079-2506-4494-8d46-5d33c514b6ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11f9be98-90d6-4c67-8d66-0b944f5a2a2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:58:01.303556 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-cef87079-2506-4494-8d46-5d33c514b6ed tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.956020 Jun 27 15:58:01.304438 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 529/1043] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 15:58:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:58:01.316851 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9c0298e1-c5de-4b54-96cd-9b99ee0c679a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:01.317676 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9c0298e1-c5de-4b54-96cd-9b99ee0c679a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:01.527870 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9c0298e1-c5de-4b54-96cd-9b99ee0c679a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:01.543004 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9c0298e1-c5de-4b54-96cd-9b99ee0c679a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e" status: 200 len: 1241 microversion: 2.1 time: 0.231582 Jun 27 15:58:01.544122 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 515/1044] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:01 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e => generated 1241 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:58:02.568179 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-283737fa-a54c-4af4-95b7-9ae6e414f19f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:02.570155 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-283737fa-a54c-4af4-95b7-9ae6e414f19f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:02.582917 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-283737fa-a54c-4af4-95b7-9ae6e414f19f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:02.583784 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-283737fa-a54c-4af4-95b7-9ae6e414f19f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:02.585277 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-283737fa-a54c-4af4-95b7-9ae6e414f19f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:02.586223 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-283737fa-a54c-4af4-95b7-9ae6e414f19f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:02.684860 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-283737fa-a54c-4af4-95b7-9ae6e414f19f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:02.694313 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-283737fa-a54c-4af4-95b7-9ae6e414f19f tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e" status: 200 len: 1299 microversion: 2.1 time: 0.135467 Jun 27 15:58:02.694932 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 530/1045] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:02 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e => generated 1299 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:58:03.725322 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f3d858e6-33b0-4a4c-810e-31977b5be2ad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:03.726597 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f3d858e6-33b0-4a4c-810e-31977b5be2ad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:03.737980 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f3d858e6-33b0-4a4c-810e-31977b5be2ad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:03.738789 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f3d858e6-33b0-4a4c-810e-31977b5be2ad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:03.740228 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f3d858e6-33b0-4a4c-810e-31977b5be2ad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:03.741065 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f3d858e6-33b0-4a4c-810e-31977b5be2ad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:03.954332 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f3d858e6-33b0-4a4c-810e-31977b5be2ad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:03.965155 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f3d858e6-33b0-4a4c-810e-31977b5be2ad tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e" status: 200 len: 1366 microversion: 2.1 time: 0.248192 Jun 27 15:58:03.966052 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 516/1046] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:03 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:58:04.565062 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-96167ca9-c997-4478-ac0d-d7cbfc12d770 req-75690f55-061f-404a-b3ba-bf42b0d4cc7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39e4b68-47ff-444f-b015-d9c33a70e43e", "tag": "ab389626-c585-496d-bea8-f5b2c63a39da"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:58:04.617051 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-96167ca9-c997-4478-ac0d-d7cbfc12d770 req-75690f55-061f-404a-b3ba-bf42b0d4cc7e service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:04.617912 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-96167ca9-c997-4478-ac0d-d7cbfc12d770 req-75690f55-061f-404a-b3ba-bf42b0d4cc7e service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:04.640520 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-96167ca9-c997-4478-ac0d-d7cbfc12d770 req-75690f55-061f-404a-b3ba-bf42b0d4cc7e service nova] Creating event network-changed:ab389626-c585-496d-bea8-f5b2c63a39da for instance d39e4b68-47ff-444f-b015-d9c33a70e43e on hv-cinder-84780 Jun 27 15:58:04.647773 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-96167ca9-c997-4478-ac0d-d7cbfc12d770 req-75690f55-061f-404a-b3ba-bf42b0d4cc7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092463 Jun 27 15:58:04.649196 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 531/1047] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:58:04.984540 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-900806b3-7984-4da4-9570-497495ee1132 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:04.985287 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-900806b3-7984-4da4-9570-497495ee1132 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:04.992937 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-900806b3-7984-4da4-9570-497495ee1132 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:04.993393 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-900806b3-7984-4da4-9570-497495ee1132 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:04.994235 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-900806b3-7984-4da4-9570-497495ee1132 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:04.994674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-900806b3-7984-4da4-9570-497495ee1132 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:05.151791 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-900806b3-7984-4da4-9570-497495ee1132 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:05.161180 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-900806b3-7984-4da4-9570-497495ee1132 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e" status: 200 len: 1366 microversion: 2.1 time: 0.181071 Jun 27 15:58:05.161805 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 517/1048] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:04 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:58:06.186256 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b0e8b7a2-f6a8-43be-8c1e-fa492477e6a9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:06.187524 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b0e8b7a2-f6a8-43be-8c1e-fa492477e6a9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:06.199309 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b0e8b7a2-f6a8-43be-8c1e-fa492477e6a9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:06.200133 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b0e8b7a2-f6a8-43be-8c1e-fa492477e6a9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:06.201720 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b0e8b7a2-f6a8-43be-8c1e-fa492477e6a9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:06.202479 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b0e8b7a2-f6a8-43be-8c1e-fa492477e6a9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:06.389532 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b0e8b7a2-f6a8-43be-8c1e-fa492477e6a9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:06.398976 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b0e8b7a2-f6a8-43be-8c1e-fa492477e6a9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e" status: 200 len: 1366 microversion: 2.1 time: 0.221549 Jun 27 15:58:06.399576 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 532/1049] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:06 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:58:07.416550 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-fdbe0772-b380-4344-b6a5-32cb118f7eb1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:07.418486 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-fdbe0772-b380-4344-b6a5-32cb118f7eb1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:07.431696 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fdbe0772-b380-4344-b6a5-32cb118f7eb1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:07.432629 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fdbe0772-b380-4344-b6a5-32cb118f7eb1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:07.433700 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fdbe0772-b380-4344-b6a5-32cb118f7eb1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:07.434431 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-fdbe0772-b380-4344-b6a5-32cb118f7eb1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:07.590748 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-fdbe0772-b380-4344-b6a5-32cb118f7eb1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:07.599760 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-fdbe0772-b380-4344-b6a5-32cb118f7eb1 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e" status: 200 len: 1366 microversion: 2.1 time: 0.187123 Jun 27 15:58:07.600352 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 518/1050] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:07 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:58:08.617968 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-87715745-8677-4a5a-a47e-cfde7d9983e0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:08.618839 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-87715745-8677-4a5a-a47e-cfde7d9983e0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:08.630034 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-87715745-8677-4a5a-a47e-cfde7d9983e0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:08.630971 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-87715745-8677-4a5a-a47e-cfde7d9983e0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:08.632382 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-87715745-8677-4a5a-a47e-cfde7d9983e0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:08.633170 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-87715745-8677-4a5a-a47e-cfde7d9983e0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:08.856797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-87715745-8677-4a5a-a47e-cfde7d9983e0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:08.867288 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-87715745-8677-4a5a-a47e-cfde7d9983e0 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e" status: 200 len: 1366 microversion: 2.1 time: 0.253450 Jun 27 15:58:08.868279 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 533/1051] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:08 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:58:09.747955 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a3d2b913-4a7a-484a-864a-09bf24d6210e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:09.748945 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a3d2b913-4a7a-484a-864a-09bf24d6210e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:09.752410 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-3c1dd127-41f4-4a3d-82c0-b8a1d9089dce req-2ac672d0-870a-4d11-b333-833fdee90a2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64ee8b86-556e-4dc8-bff9-3b5c99f14056", "tag": "516f1166-861f-48fb-965b-e8b29530c5d9"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:58:09.760064 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a3d2b913-4a7a-484a-864a-09bf24d6210e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:09.760746 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a3d2b913-4a7a-484a-864a-09bf24d6210e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:09.761915 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a3d2b913-4a7a-484a-864a-09bf24d6210e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:09.762562 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a3d2b913-4a7a-484a-864a-09bf24d6210e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:09.766336 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-3c1dd127-41f4-4a3d-82c0-b8a1d9089dce req-2ac672d0-870a-4d11-b333-833fdee90a2e service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:09.766959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-3c1dd127-41f4-4a3d-82c0-b8a1d9089dce req-2ac672d0-870a-4d11-b333-833fdee90a2e service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:09.787813 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-3c1dd127-41f4-4a3d-82c0-b8a1d9089dce req-2ac672d0-870a-4d11-b333-833fdee90a2e service nova] Creating event network-changed:516f1166-861f-48fb-965b-e8b29530c5d9 for instance 64ee8b86-556e-4dc8-bff9-3b5c99f14056 on hv-cinder-84780 Jun 27 15:58:09.795452 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-3c1dd127-41f4-4a3d-82c0-b8a1d9089dce req-2ac672d0-870a-4d11-b333-833fdee90a2e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049309 Jun 27 15:58:09.797089 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 534/1052] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:58:09.813554 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a3d2b913-4a7a-484a-864a-09bf24d6210e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Going to try to terminate instance {{(pid=129472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:58:09.894711 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-276877fc-26c8-4fcd-9ada-ebd69556e464 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:09.895972 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-276877fc-26c8-4fcd-9ada-ebd69556e464 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:09.902827 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-276877fc-26c8-4fcd-9ada-ebd69556e464 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:09.903367 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-276877fc-26c8-4fcd-9ada-ebd69556e464 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:09.904432 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-276877fc-26c8-4fcd-9ada-ebd69556e464 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:09.905115 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-276877fc-26c8-4fcd-9ada-ebd69556e464 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:09.958739 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-a3d2b913-4a7a-484a-864a-09bf24d6210e tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "DELETE /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 204 len: 0 microversion: 2.1 time: 0.217302 Jun 27 15:58:09.960650 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 519/1053] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:58:09 2022] DELETE /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:58:09.979925 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-70b85b88-2b6f-4871-b4c9-fead51188a40 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:09.986298 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-70b85b88-2b6f-4871-b4c9-fead51188a40 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:09.996760 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-70b85b88-2b6f-4871-b4c9-fead51188a40 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:09.997770 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-70b85b88-2b6f-4871-b4c9-fead51188a40 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:10.000063 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-70b85b88-2b6f-4871-b4c9-fead51188a40 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:10.000968 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-70b85b88-2b6f-4871-b4c9-fead51188a40 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:10.128083 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-276877fc-26c8-4fcd-9ada-ebd69556e464 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:10.142314 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-276877fc-26c8-4fcd-9ada-ebd69556e464 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e" status: 200 len: 1366 microversion: 2.1 time: 0.252892 Jun 27 15:58:10.142965 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 535/1054] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:09 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:58:10.207199 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-70b85b88-2b6f-4871-b4c9-fead51188a40 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:10.216152 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-70b85b88-2b6f-4871-b4c9-fead51188a40 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1575 microversion: 2.1 time: 0.248369 Jun 27 15:58:10.216924 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 520/1055] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:09 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1575 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:58:10.729788 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-ee92fc9d-7c9a-4d53-bbda-0537636a4f5f req-7286b75f-9938-4282-bedb-c119eafcb5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39e4b68-47ff-444f-b015-d9c33a70e43e", "name": "network-vif-plugged", "status": "completed", "tag": "ab389626-c585-496d-bea8-f5b2c63a39da"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:58:10.740289 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-ee92fc9d-7c9a-4d53-bbda-0537636a4f5f req-7286b75f-9938-4282-bedb-c119eafcb5a7 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:10.740916 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-ee92fc9d-7c9a-4d53-bbda-0537636a4f5f req-7286b75f-9938-4282-bedb-c119eafcb5a7 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:10.756099 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-ee92fc9d-7c9a-4d53-bbda-0537636a4f5f req-7286b75f-9938-4282-bedb-c119eafcb5a7 service nova] Creating event network-vif-plugged:ab389626-c585-496d-bea8-f5b2c63a39da for instance d39e4b68-47ff-444f-b015-d9c33a70e43e on hv-cinder-84780 Jun 27 15:58:10.762124 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-ee92fc9d-7c9a-4d53-bbda-0537636a4f5f req-7286b75f-9938-4282-bedb-c119eafcb5a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036371 Jun 27 15:58:10.763191 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 536/1056] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:58:11.173614 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-4e4bc0aa-3eba-4bac-851b-5e08edc398e2 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:11.174693 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-4e4bc0aa-3eba-4bac-851b-5e08edc398e2 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:11.183849 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4e4bc0aa-3eba-4bac-851b-5e08edc398e2 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:11.184674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4e4bc0aa-3eba-4bac-851b-5e08edc398e2 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:11.186500 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4e4bc0aa-3eba-4bac-851b-5e08edc398e2 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:11.187170 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-4e4bc0aa-3eba-4bac-851b-5e08edc398e2 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:11.236178 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=2 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:58:11.245757 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-5ecda1de-a229-426a-87eb-57bb6a6aff14 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:11.247612 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-5ecda1de-a229-426a-87eb-57bb6a6aff14 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:11.251851 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=6 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:58:11.267682 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5ecda1de-a229-426a-87eb-57bb6a6aff14 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:11.269738 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5ecda1de-a229-426a-87eb-57bb6a6aff14 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:11.271473 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5ecda1de-a229-426a-87eb-57bb6a6aff14 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:11.272634 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5ecda1de-a229-426a-87eb-57bb6a6aff14 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:11.528581 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-4e4bc0aa-3eba-4bac-851b-5e08edc398e2 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:11.541018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=6 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:58:11.546489 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-4e4bc0aa-3eba-4bac-851b-5e08edc398e2 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e" status: 200 len: 1366 microversion: 2.1 time: 0.377805 Jun 27 15:58:11.560023 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 521/1057] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:11 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:58:11.567085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-5ecda1de-a229-426a-87eb-57bb6a6aff14 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:11.575486 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-5ecda1de-a229-426a-87eb-57bb6a6aff14 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1575 microversion: 2.1 time: 0.341384 Jun 27 15:58:11.576073 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 537/1058] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:11 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1575 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:58:12.469276 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-ced7968a-d363-44fd-ba13-9b1aefb8a553 req-e317eb13-1a6e-4d1f-858a-70a54f7e4bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64ee8b86-556e-4dc8-bff9-3b5c99f14056", "name": "network-vif-deleted", "tag": "516f1166-861f-48fb-965b-e8b29530c5d9"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:58:12.486663 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-ced7968a-d363-44fd-ba13-9b1aefb8a553 req-e317eb13-1a6e-4d1f-858a-70a54f7e4bdc service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:12.488102 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-ced7968a-d363-44fd-ba13-9b1aefb8a553 req-e317eb13-1a6e-4d1f-858a-70a54f7e4bdc service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:12.509599 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-ced7968a-d363-44fd-ba13-9b1aefb8a553 req-e317eb13-1a6e-4d1f-858a-70a54f7e4bdc service nova] Creating event network-vif-deleted:516f1166-861f-48fb-965b-e8b29530c5d9 for instance 64ee8b86-556e-4dc8-bff9-3b5c99f14056 on hv-cinder-84780 Jun 27 15:58:12.517603 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-ced7968a-d363-44fd-ba13-9b1aefb8a553 req-e317eb13-1a6e-4d1f-858a-70a54f7e4bdc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056058 Jun 27 15:58:12.518423 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 522/1059] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:58:12.568817 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ae21251a-8316-4a28-864c-e4ac2f7d088b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:12.569689 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-ae21251a-8316-4a28-864c-e4ac2f7d088b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:12.577003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ae21251a-8316-4a28-864c-e4ac2f7d088b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:12.578354 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ae21251a-8316-4a28-864c-e4ac2f7d088b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:12.578354 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ae21251a-8316-4a28-864c-e4ac2f7d088b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:12.578752 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ae21251a-8316-4a28-864c-e4ac2f7d088b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:12.602424 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ed00ef48-8ba7-46d5-8232-ffe0c8483b56 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:12.604145 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-ed00ef48-8ba7-46d5-8232-ffe0c8483b56 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:12.618109 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ed00ef48-8ba7-46d5-8232-ffe0c8483b56 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:12.618808 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ed00ef48-8ba7-46d5-8232-ffe0c8483b56 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:12.620318 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ed00ef48-8ba7-46d5-8232-ffe0c8483b56 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:12.621114 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ed00ef48-8ba7-46d5-8232-ffe0c8483b56 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:12.726867 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ed00ef48-8ba7-46d5-8232-ffe0c8483b56 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:12.742766 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ed00ef48-8ba7-46d5-8232-ffe0c8483b56 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1389 microversion: 2.1 time: 0.149285 Jun 27 15:58:12.746464 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 523/1060] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:12 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:58:12.831774 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-ae21251a-8316-4a28-864c-e4ac2f7d088b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:12.842424 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-ae21251a-8316-4a28-864c-e4ac2f7d088b tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e" status: 200 len: 1366 microversion: 2.1 time: 0.278073 Jun 27 15:58:12.843214 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 538/1061] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:12 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:58:13.764872 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3e67097d-0696-451c-9c58-c7d911abada8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:13.765822 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3e67097d-0696-451c-9c58-c7d911abada8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:13.775029 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3e67097d-0696-451c-9c58-c7d911abada8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:13.775811 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3e67097d-0696-451c-9c58-c7d911abada8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:13.776697 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3e67097d-0696-451c-9c58-c7d911abada8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:13.777228 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3e67097d-0696-451c-9c58-c7d911abada8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:13.783477 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:58:13.821267 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3e67097d-0696-451c-9c58-c7d911abada8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:13.821726 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3e67097d-0696-451c-9c58-c7d911abada8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:13.822584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-3e67097d-0696-451c-9c58-c7d911abada8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lazy-loading 'fault' on Instance uuid 64ee8b86-556e-4dc8-bff9-3b5c99f14056 {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:58:13.870495 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-eafd4256-f4d0-400d-aabf-a3cf12b7af09 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:13.871376 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-eafd4256-f4d0-400d-aabf-a3cf12b7af09 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:13.875295 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:58:13.881966 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3e67097d-0696-451c-9c58-c7d911abada8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:13.889160 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eafd4256-f4d0-400d-aabf-a3cf12b7af09 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:13.890002 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eafd4256-f4d0-400d-aabf-a3cf12b7af09 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:13.890188 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3e67097d-0696-451c-9c58-c7d911abada8 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 200 len: 1183 microversion: 2.1 time: 0.129314 Jun 27 15:58:13.890710 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 524/1062] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:13 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 1183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:58:13.891430 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eafd4256-f4d0-400d-aabf-a3cf12b7af09 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:13.892185 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-eafd4256-f4d0-400d-aabf-a3cf12b7af09 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:13.899180 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:58:14.092507 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-eafd4256-f4d0-400d-aabf-a3cf12b7af09 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:14.101821 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-eafd4256-f4d0-400d-aabf-a3cf12b7af09 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e" status: 200 len: 1555 microversion: 2.1 time: 0.239912 Jun 27 15:58:14.102467 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 539/1063] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:13 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e => generated 1555 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:58:14.123556 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-257985ef-2732-4264-98e0-a273bf739583 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:14.124369 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-257985ef-2732-4264-98e0-a273bf739583 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:14.134885 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-257985ef-2732-4264-98e0-a273bf739583 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:14.135600 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-257985ef-2732-4264-98e0-a273bf739583 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:14.136867 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-257985ef-2732-4264-98e0-a273bf739583 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:14.137576 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-257985ef-2732-4264-98e0-a273bf739583 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:14.266848 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-257985ef-2732-4264-98e0-a273bf739583 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150004 Jun 27 15:58:14.267859 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 525/1064] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jun 27 15:58:14 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:58:14.910901 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-43929c30-da3a-4de2-8e01-8be38db79741 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:14.911510 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-43929c30-da3a-4de2-8e01-8be38db79741 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 64ee8b86-556e-4dc8-bff9-3b5c99f14056] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:14.920085 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-43929c30-da3a-4de2-8e01-8be38db79741 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:14.920806 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-43929c30-da3a-4de2-8e01-8be38db79741 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:14.921834 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-43929c30-da3a-4de2-8e01-8be38db79741 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:14.922302 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-43929c30-da3a-4de2-8e01-8be38db79741 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:14.939348 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-43929c30-da3a-4de2-8e01-8be38db79741 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] HTTP exception thrown: Instance 64ee8b86-556e-4dc8-bff9-3b5c99f14056 could not be found. Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-43929c30-da3a-4de2-8e01-8be38db79741 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Request method failure captured: Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 HTTP/1.1 Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudGzzBw054Nc9abhPFH0qG7lFvyDvvOK1YUA8U7uxWE-o8JlB8KT8dAn12EPY-KZRC7Vj99JG05PLw4JgNl5XZvouQZQZyKDVBaA3LmEEuar-6PgxVD4ZtKxrnhSnDdyiv7QpvDRq8a5zG_wuq8hM3haywiWIrbEPOw1tdj890mDLQA Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: ec9f767e3b4d4fb78f86a611ed9f47c5 Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-TestVolumeBootPattern-34943189 Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:58:14.941695 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:58:14.943450 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ec9f767e3b4d4fb78f86a611ed9f47c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ec9f767e3b4d4fb78f86a611ed9f47c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ec9f767e3b4d4fb78f86a611ed9f47c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ec9f767e3b4d4fb78f86a611ed9f47c5", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:58:14.943450 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-TestVolumeBootPattern-34943189 Jun 27 15:58:14.943450 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: ec9f767e3b4d4fb78f86a611ed9f47c5 Jun 27 15:58:14.943450 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-TestVolumeBootPattern-34943189 Jun 27 15:58:14.943450 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-TestVolumeBootPattern-34943189-project Jun 27 15:58:14.943450 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:58:14.943450 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:58:14.943450 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 25024a505319480ab00f4c7e58de600c Jun 27 15:58:14.943450 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-TestVolumeBootPattern-34943189-project Jun 27 15:58:14.943450 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:58:14.943450 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance 64ee8b86-556e-4dc8-bff9-3b5c99f14056 could not be found. Jun 27 15:58:14.943450 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': '64ee8b86-556e-4dc8-bff9-3b5c99f14056'} Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64ee8b86-556e-4dc8-bff9-3b5c99f14056 could not be found. Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:58:14.944903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:58:14.947357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:58:14.947357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:58:14.947357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:58:14.947357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:58:14.947357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:58:14.947357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:58:14.947357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:58:14.947357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64ee8b86-556e-4dc8-bff9-3b5c99f14056 could not be found. Jun 27 15:58:14.947357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:58:14.947357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:58:14.947357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:58:14.947357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:58:14.947357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:58:14.947357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:58:14.947357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:58:14.947357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:58:14.947357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64ee8b86-556e-4dc8-bff9-3b5c99f14056 could not be found. Jun 27 15:58:14.947357 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:58:14.950752 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-43929c30-da3a-4de2-8e01-8be38db79741 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Returning 404 to user: Instance 64ee8b86-556e-4dc8-bff9-3b5c99f14056 could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:58:14.950752 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-43929c30-da3a-4de2-8e01-8be38db79741 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056" status: 404 len: 111 microversion: 2.1 time: 0.037316 Jun 27 15:58:14.950752 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 540/1065] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:14 2022] GET /compute/v2.1/servers/64ee8b86-556e-4dc8-bff9-3b5c99f14056 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:58:15.782746 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-ee47a241-83c1-42fd-9632-cb706eb80b76 req-f27a3dfc-930c-4332-9b58-8d1dc37d07a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39e4b68-47ff-444f-b015-d9c33a70e43e", "tag": "ab389626-c585-496d-bea8-f5b2c63a39da"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:58:15.787064 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:58:15.793988 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-ee47a241-83c1-42fd-9632-cb706eb80b76 req-f27a3dfc-930c-4332-9b58-8d1dc37d07a5 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:15.793988 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-ee47a241-83c1-42fd-9632-cb706eb80b76 req-f27a3dfc-930c-4332-9b58-8d1dc37d07a5 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:15.811679 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-ee47a241-83c1-42fd-9632-cb706eb80b76 req-f27a3dfc-930c-4332-9b58-8d1dc37d07a5 service nova] Creating event network-changed:ab389626-c585-496d-bea8-f5b2c63a39da for instance d39e4b68-47ff-444f-b015-d9c33a70e43e on hv-cinder-84780 Jun 27 15:58:15.817874 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-ee47a241-83c1-42fd-9632-cb706eb80b76 req-f27a3dfc-930c-4332-9b58-8d1dc37d07a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039122 Jun 27 15:58:15.818518 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 526/1066] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:58:16.346528 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:58:16.346907 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Mon Jun 27 15:58:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 15:58:18.364314 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-d84dd345-2499-4c39-a60e-d431fde557eb req-23fe7e22-096f-4a4c-823a-d7626fa3d566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a7d7777-ce5f-4034-b1b7-2856430ab182", "tag": "04e8591d-d665-4504-be77-3a1e0d3a1940"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:58:18.367172 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3b1ab77c-3e3a-41ec-8bfc-1192eca44990 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:18.368040 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3b1ab77c-3e3a-41ec-8bfc-1192eca44990 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:18.375176 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-d84dd345-2499-4c39-a60e-d431fde557eb req-23fe7e22-096f-4a4c-823a-d7626fa3d566 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:18.375750 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-d84dd345-2499-4c39-a60e-d431fde557eb req-23fe7e22-096f-4a4c-823a-d7626fa3d566 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:18.381164 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3b1ab77c-3e3a-41ec-8bfc-1192eca44990 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:18.382108 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3b1ab77c-3e3a-41ec-8bfc-1192eca44990 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:18.383625 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3b1ab77c-3e3a-41ec-8bfc-1192eca44990 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:18.384406 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3b1ab77c-3e3a-41ec-8bfc-1192eca44990 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:18.388466 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-d84dd345-2499-4c39-a60e-d431fde557eb req-23fe7e22-096f-4a4c-823a-d7626fa3d566 service nova] Creating event network-changed:04e8591d-d665-4504-be77-3a1e0d3a1940 for instance 0a7d7777-ce5f-4034-b1b7-2856430ab182 on hv-cinder-84780 Jun 27 15:58:18.394661 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-d84dd345-2499-4c39-a60e-d431fde557eb req-23fe7e22-096f-4a4c-823a-d7626fa3d566 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035771 Jun 27 15:58:18.396011 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 527/1067] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:58:18.437341 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3b1ab77c-3e3a-41ec-8bfc-1192eca44990 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Going to try to terminate instance {{(pid=129473) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:58:18.555303 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3b1ab77c-3e3a-41ec-8bfc-1192eca44990 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 204 len: 0 microversion: 2.1 time: 0.196341 Jun 27 15:58:18.555960 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 541/1068] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:58:18 2022] DELETE /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:58:18.573731 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3dfae8ee-fa5e-46b4-ab7b-b05922248f54 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:18.575271 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3dfae8ee-fa5e-46b4-ab7b-b05922248f54 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:18.588210 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3dfae8ee-fa5e-46b4-ab7b-b05922248f54 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:18.590191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3dfae8ee-fa5e-46b4-ab7b-b05922248f54 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:18.592222 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3dfae8ee-fa5e-46b4-ab7b-b05922248f54 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:18.593183 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3dfae8ee-fa5e-46b4-ab7b-b05922248f54 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:18.753229 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3dfae8ee-fa5e-46b4-ab7b-b05922248f54 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:18.761507 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3dfae8ee-fa5e-46b4-ab7b-b05922248f54 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1576 microversion: 2.1 time: 0.199599 Jun 27 15:58:18.762137 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 528/1069] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:18 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:58:19.787003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-6693f747-465c-4611-86c7-7aa5eba79c4a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:19.788254 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-6693f747-465c-4611-86c7-7aa5eba79c4a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:19.800321 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6693f747-465c-4611-86c7-7aa5eba79c4a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:19.800997 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6693f747-465c-4611-86c7-7aa5eba79c4a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:19.802292 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6693f747-465c-4611-86c7-7aa5eba79c4a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:19.803004 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-6693f747-465c-4611-86c7-7aa5eba79c4a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:20.007274 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-6693f747-465c-4611-86c7-7aa5eba79c4a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:20.017424 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-6693f747-465c-4611-86c7-7aa5eba79c4a tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1576 microversion: 2.1 time: 0.239850 Jun 27 15:58:20.018093 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 542/1070] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:19 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:58:20.956272 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-08483b9a-a41a-4009-ae15-6e2b5846c185 req-71ce29bd-160c-4910-b895-63c84e563dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a7d7777-ce5f-4034-b1b7-2856430ab182", "name": "network-vif-deleted", "tag": "04e8591d-d665-4504-be77-3a1e0d3a1940"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:58:20.967155 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-08483b9a-a41a-4009-ae15-6e2b5846c185 req-71ce29bd-160c-4910-b895-63c84e563dca service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:20.967700 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-08483b9a-a41a-4009-ae15-6e2b5846c185 req-71ce29bd-160c-4910-b895-63c84e563dca service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:20.981565 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-08483b9a-a41a-4009-ae15-6e2b5846c185 req-71ce29bd-160c-4910-b895-63c84e563dca service nova] Creating event network-vif-deleted:04e8591d-d665-4504-be77-3a1e0d3a1940 for instance 0a7d7777-ce5f-4034-b1b7-2856430ab182 on hv-cinder-84780 Jun 27 15:58:20.987644 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-08483b9a-a41a-4009-ae15-6e2b5846c185 req-71ce29bd-160c-4910-b895-63c84e563dca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034844 Jun 27 15:58:20.988525 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 529/1071] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:58:21.038866 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-7cf308ca-f148-4211-9f1e-24eb840a1ce6 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:21.039909 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-7cf308ca-f148-4211-9f1e-24eb840a1ce6 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:21.047333 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7cf308ca-f148-4211-9f1e-24eb840a1ce6 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:21.047915 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7cf308ca-f148-4211-9f1e-24eb840a1ce6 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:21.049623 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7cf308ca-f148-4211-9f1e-24eb840a1ce6 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:21.050909 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7cf308ca-f148-4211-9f1e-24eb840a1ce6 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:21.131480 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-7cf308ca-f148-4211-9f1e-24eb840a1ce6 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25024a505319480ab00f4c7e58de600c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9f767e3b4d4fb78f86a611ed9f47c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:21.142344 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-7cf308ca-f148-4211-9f1e-24eb840a1ce6 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 200 len: 1225 microversion: 2.1 time: 0.109213 Jun 27 15:58:21.143895 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 543/1072] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:21 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:58:22.167168 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a378b9dc-3a04-44f6-9d54-b6715387469b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:22.168436 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-a378b9dc-3a04-44f6-9d54-b6715387469b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: 0a7d7777-ce5f-4034-b1b7-2856430ab182] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:22.178861 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a378b9dc-3a04-44f6-9d54-b6715387469b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:22.179381 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a378b9dc-3a04-44f6-9d54-b6715387469b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:22.180172 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a378b9dc-3a04-44f6-9d54-b6715387469b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:22.180617 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-a378b9dc-3a04-44f6-9d54-b6715387469b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:22.196743 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-a378b9dc-3a04-44f6-9d54-b6715387469b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] HTTP exception thrown: Instance 0a7d7777-ce5f-4034-b1b7-2856430ab182 could not be found. Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a378b9dc-3a04-44f6-9d54-b6715387469b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Request method failure captured: Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 HTTP/1.1 Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudGzzBw054Nc9abhPFH0qG7lFvyDvvOK1YUA8U7uxWE-o8JlB8KT8dAn12EPY-KZRC7Vj99JG05PLw4JgNl5XZvouQZQZyKDVBaA3LmEEuar-6PgxVD4ZtKxrnhSnDdyiv7QpvDRq8a5zG_wuq8hM3haywiWIrbEPOw1tdj890mDLQA Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: ec9f767e3b4d4fb78f86a611ed9f47c5 Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-TestVolumeBootPattern-34943189 Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:58:22.198583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:58:22.201018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ec9f767e3b4d4fb78f86a611ed9f47c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ec9f767e3b4d4fb78f86a611ed9f47c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ec9f767e3b4d4fb78f86a611ed9f47c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ec9f767e3b4d4fb78f86a611ed9f47c5", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:58:22.201018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-TestVolumeBootPattern-34943189 Jun 27 15:58:22.201018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: ec9f767e3b4d4fb78f86a611ed9f47c5 Jun 27 15:58:22.201018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-TestVolumeBootPattern-34943189 Jun 27 15:58:22.201018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-TestVolumeBootPattern-34943189-project Jun 27 15:58:22.201018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:58:22.201018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:58:22.201018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: 25024a505319480ab00f4c7e58de600c Jun 27 15:58:22.201018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-TestVolumeBootPattern-34943189-project Jun 27 15:58:22.201018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:58:22.201018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance 0a7d7777-ce5f-4034-b1b7-2856430ab182 could not be found. Jun 27 15:58:22.201018 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': '0a7d7777-ce5f-4034-b1b7-2856430ab182'} Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a7d7777-ce5f-4034-b1b7-2856430ab182 could not be found. Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:58:22.202538 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:58:22.204900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:58:22.204900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:58:22.204900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:58:22.204900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:58:22.204900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:58:22.204900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:58:22.204900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:58:22.204900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a7d7777-ce5f-4034-b1b7-2856430ab182 could not be found. Jun 27 15:58:22.204900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:58:22.204900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:58:22.204900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:58:22.204900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:58:22.204900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:58:22.204900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:58:22.204900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:58:22.204900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:58:22.204900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a7d7777-ce5f-4034-b1b7-2856430ab182 could not be found. Jun 27 15:58:22.204900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:58:22.207630 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-a378b9dc-3a04-44f6-9d54-b6715387469b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Returning 404 to user: Instance 0a7d7777-ce5f-4034-b1b7-2856430ab182 could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:58:22.207630 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-a378b9dc-3a04-44f6-9d54-b6715387469b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182" status: 404 len: 111 microversion: 2.1 time: 0.043064 Jun 27 15:58:22.207630 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 530/1073] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:22 2022] GET /compute/v2.1/servers/0a7d7777-ce5f-4034-b1b7-2856430ab182 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:58:22.743319 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ea8b1ebe-7a87-48b6-9ec5-e5d603ecc04d tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:22.744220 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-ea8b1ebe-7a87-48b6-9ec5-e5d603ecc04d tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:22.751029 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ea8b1ebe-7a87-48b6-9ec5-e5d603ecc04d tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:22.751480 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ea8b1ebe-7a87-48b6-9ec5-e5d603ecc04d tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:22.752914 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ea8b1ebe-7a87-48b6-9ec5-e5d603ecc04d tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:22.753537 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ea8b1ebe-7a87-48b6-9ec5-e5d603ecc04d tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:22.772109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-ea8b1ebe-7a87-48b6-9ec5-e5d603ecc04d tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] HTTP exception thrown: Instance b6a90fed-157b-47f0-bd62-401e29342025 could not be found. Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ea8b1ebe-7a87-48b6-9ec5-e5d603ecc04d tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Request method failure captured: Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: DELETE /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 HTTP/1.1 Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudGzzBw054Nc9abhPFH0qG7lFvyDvvOK1YUA8U7uxWE-o8JlB8KT8dAn12EPY-KZRC7Vj99JG05PLw4JgNl5XZvouQZQZyKDVBaA3LmEEuar-6PgxVD4ZtKxrnhSnDdyiv7QpvDRq8a5zG_wuq8hM3haywiWIrbEPOw1tdj890mDLQA Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: ec9f767e3b4d4fb78f86a611ed9f47c5 Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-TestVolumeBootPattern-34943189 Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:58:22.773922 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:58:22.775900 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ec9f767e3b4d4fb78f86a611ed9f47c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ec9f767e3b4d4fb78f86a611ed9f47c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ec9f767e3b4d4fb78f86a611ed9f47c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ec9f767e3b4d4fb78f86a611ed9f47c5", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:58:22.775900 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-TestVolumeBootPattern-34943189 Jun 27 15:58:22.775900 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: ec9f767e3b4d4fb78f86a611ed9f47c5 Jun 27 15:58:22.775900 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-TestVolumeBootPattern-34943189 Jun 27 15:58:22.775900 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-TestVolumeBootPattern-34943189-project Jun 27 15:58:22.775900 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:58:22.775900 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:58:22.775900 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: 25024a505319480ab00f4c7e58de600c Jun 27 15:58:22.775900 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-TestVolumeBootPattern-34943189-project Jun 27 15:58:22.775900 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:58:22.775900 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance b6a90fed-157b-47f0-bd62-401e29342025 could not be found. Jun 27 15:58:22.775900 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': 'b6a90fed-157b-47f0-bd62-401e29342025'} Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a90fed-157b-47f0-bd62-401e29342025 could not be found. Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:58:22.777569 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a90fed-157b-47f0-bd62-401e29342025 could not be found. Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a90fed-157b-47f0-bd62-401e29342025 could not be found. Jun 27 15:58:22.781603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:58:22.785004 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ea8b1ebe-7a87-48b6-9ec5-e5d603ecc04d tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Returning 404 to user: Instance b6a90fed-157b-47f0-bd62-401e29342025 could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:58:22.785004 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-ea8b1ebe-7a87-48b6-9ec5-e5d603ecc04d tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 404 len: 111 microversion: 2.1 time: 0.036179 Jun 27 15:58:22.785004 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 544/1074] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:58:22 2022] DELETE /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:58:22.788610 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-384dbc53-7fe6-4715-a9e7-34fd6c11bc0b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:22.789375 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-384dbc53-7fe6-4715-a9e7-34fd6c11bc0b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] [instance: b6a90fed-157b-47f0-bd62-401e29342025] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:22.797232 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-384dbc53-7fe6-4715-a9e7-34fd6c11bc0b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:22.797707 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-384dbc53-7fe6-4715-a9e7-34fd6c11bc0b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:22.798511 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-384dbc53-7fe6-4715-a9e7-34fd6c11bc0b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:22.798951 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-384dbc53-7fe6-4715-a9e7-34fd6c11bc0b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:22.824631 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-384dbc53-7fe6-4715-a9e7-34fd6c11bc0b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] HTTP exception thrown: Instance b6a90fed-157b-47f0-bd62-401e29342025 could not be found. Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-384dbc53-7fe6-4715-a9e7-34fd6c11bc0b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Request method failure captured: Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 HTTP/1.1 Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudGzzBw054Nc9abhPFH0qG7lFvyDvvOK1YUA8U7uxWE-o8JlB8KT8dAn12EPY-KZRC7Vj99JG05PLw4JgNl5XZvouQZQZyKDVBaA3LmEEuar-6PgxVD4ZtKxrnhSnDdyiv7QpvDRq8a5zG_wuq8hM3haywiWIrbEPOw1tdj890mDLQA Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: ec9f767e3b4d4fb78f86a611ed9f47c5 Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-TestVolumeBootPattern-34943189 Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:58:22.827865 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:58:22.830182 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ec9f767e3b4d4fb78f86a611ed9f47c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ec9f767e3b4d4fb78f86a611ed9f47c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ec9f767e3b4d4fb78f86a611ed9f47c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ec9f767e3b4d4fb78f86a611ed9f47c5", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:58:22.830182 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-TestVolumeBootPattern-34943189 Jun 27 15:58:22.830182 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: ec9f767e3b4d4fb78f86a611ed9f47c5 Jun 27 15:58:22.830182 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-TestVolumeBootPattern-34943189 Jun 27 15:58:22.830182 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-TestVolumeBootPattern-34943189-project Jun 27 15:58:22.830182 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:58:22.830182 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:58:22.830182 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: 25024a505319480ab00f4c7e58de600c Jun 27 15:58:22.830182 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-TestVolumeBootPattern-34943189-project Jun 27 15:58:22.830182 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:58:22.830182 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance b6a90fed-157b-47f0-bd62-401e29342025 could not be found. Jun 27 15:58:22.830182 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': 'b6a90fed-157b-47f0-bd62-401e29342025'} Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a90fed-157b-47f0-bd62-401e29342025 could not be found. Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:58:22.832360 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:58:22.834839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:58:22.834839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:58:22.834839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:58:22.834839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:58:22.834839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:58:22.834839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:58:22.834839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:58:22.834839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a90fed-157b-47f0-bd62-401e29342025 could not be found. Jun 27 15:58:22.834839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:58:22.834839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:58:22.834839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:58:22.834839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:58:22.834839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:58:22.834839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:58:22.834839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:58:22.834839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:58:22.834839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a90fed-157b-47f0-bd62-401e29342025 could not be found. Jun 27 15:58:22.834839 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:58:22.839374 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-384dbc53-7fe6-4715-a9e7-34fd6c11bc0b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Returning 404 to user: Instance b6a90fed-157b-47f0-bd62-401e29342025 could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:58:22.839374 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-384dbc53-7fe6-4715-a9e7-34fd6c11bc0b tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025" status: 404 len: 111 microversion: 2.1 time: 0.047126 Jun 27 15:58:22.839374 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 531/1075] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:22 2022] GET /compute/v2.1/servers/b6a90fed-157b-47f0-bd62-401e29342025 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:58:24.256729 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-f83b1e30-7dbb-4de2-9829-b1d907cd7da5 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] Calling method '.version_select at 0x7fe1464891f0>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:24.287345 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-f83b1e30-7dbb-4de2-9829-b1d907cd7da5 tempest-TestVolumeBootPattern-34943189 tempest-TestVolumeBootPattern-34943189-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-121267945" status: 202 len: 0 microversion: 2.1 time: 0.035715 Jun 27 15:58:24.288089 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 545/1076] 10.222.0.20 () {58 vars in 1259 bytes} [Mon Jun 27 15:58:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-121267945 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:58:46.128359 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-1f180e3e-e598-4d70-8642-61f184115e92 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:46.129165 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-1f180e3e-e598-4d70-8642-61f184115e92 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:46.131552 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=11 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:58:46.132228 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=26 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:58:46.139077 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1f180e3e-e598-4d70-8642-61f184115e92 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:46.139529 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1f180e3e-e598-4d70-8642-61f184115e92 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:46.140327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1f180e3e-e598-4d70-8642-61f184115e92 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:46.140758 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1f180e3e-e598-4d70-8642-61f184115e92 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:46.168652 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-1f180e3e-e598-4d70-8642-61f184115e92 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e/ips" status: 200 len: 149 microversion: 2.1 time: 0.045689 Jun 27 15:58:46.169232 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 532/1077] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jun 27 15:58:46 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:58:47.594483 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:58:47.596144 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:58:47.602162 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-8f7a78be-db45-49d3-8c40-7a615ebac363 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e258286-bb60-4b1e-86f6-09485fadac46"}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:58:47.603442 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-8f7a78be-db45-49d3-8c40-7a615ebac363 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:47.614669 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8f7a78be-db45-49d3-8c40-7a615ebac363 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:47.615306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8f7a78be-db45-49d3-8c40-7a615ebac363 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:47.616240 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8f7a78be-db45-49d3-8c40-7a615ebac363 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:47.616767 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-8f7a78be-db45-49d3-8c40-7a615ebac363 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:47.956625 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-8f7a78be-db45-49d3-8c40-7a615ebac363 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "POST /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361797 Jun 27 15:58:47.957295 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 546/1078] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jun 27 15:58:47 2022] POST /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:58:55.676527 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-379c406f-8176-4804-b02b-1f95b1b0ce74 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:55.677448 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-379c406f-8176-4804-b02b-1f95b1b0ce74 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:55.685998 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-379c406f-8176-4804-b02b-1f95b1b0ce74 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:55.686448 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-379c406f-8176-4804-b02b-1f95b1b0ce74 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:55.687239 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-379c406f-8176-4804-b02b-1f95b1b0ce74 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:55.687677 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-379c406f-8176-4804-b02b-1f95b1b0ce74 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:55.788190 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-379c406f-8176-4804-b02b-1f95b1b0ce74 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lazy-loading 'services' on Instance uuid d39e4b68-47ff-444f-b015-d9c33a70e43e {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:58:55.881513 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-379c406f-8176-4804-b02b-1f95b1b0ce74 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e/os-volume_attachments/1e258286-bb60-4b1e-86f6-09485fadac46" status: 202 len: 0 microversion: 2.1 time: 0.210144 Jun 27 15:58:55.882464 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 533/1079] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jun 27 15:58:55 2022] DELETE /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e/os-volume_attachments/1e258286-bb60-4b1e-86f6-09485fadac46 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:58:55.897888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-377ef197-1418-4d23-a93a-0cf6f3be3444 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:55.899913 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-377ef197-1418-4d23-a93a-0cf6f3be3444 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:55.911602 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-377ef197-1418-4d23-a93a-0cf6f3be3444 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:55.912040 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-377ef197-1418-4d23-a93a-0cf6f3be3444 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:55.913216 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-377ef197-1418-4d23-a93a-0cf6f3be3444 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:55.913794 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-377ef197-1418-4d23-a93a-0cf6f3be3444 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:55.953583 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-377ef197-1418-4d23-a93a-0cf6f3be3444 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064986 Jun 27 15:58:55.954210 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 547/1080] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 27 15:58:55 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:58:56.969787 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-999c2597-6e63-47f2-baee-b11c87f27f23 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:56.971340 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-999c2597-6e63-47f2-baee-b11c87f27f23 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:56.978332 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-999c2597-6e63-47f2-baee-b11c87f27f23 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:56.978788 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-999c2597-6e63-47f2-baee-b11c87f27f23 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:56.979604 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-999c2597-6e63-47f2-baee-b11c87f27f23 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:56.980060 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-999c2597-6e63-47f2-baee-b11c87f27f23 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:57.015863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-999c2597-6e63-47f2-baee-b11c87f27f23 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051158 Jun 27 15:58:57.016459 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 534/1081] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jun 27 15:58:56 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 15:58:57.099366 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-09ace916-90aa-4cf2-beda-ab57b25e4d74 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:57.100225 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-09ace916-90aa-4cf2-beda-ab57b25e4d74 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:57.113525 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-09ace916-90aa-4cf2-beda-ab57b25e4d74 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:57.114464 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-09ace916-90aa-4cf2-beda-ab57b25e4d74 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:57.115906 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-09ace916-90aa-4cf2-beda-ab57b25e4d74 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:57.116775 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-09ace916-90aa-4cf2-beda-ab57b25e4d74 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:57.169227 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-09ace916-90aa-4cf2-beda-ab57b25e4d74 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Going to try to terminate instance {{(pid=129473) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:58:57.316879 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-09ace916-90aa-4cf2-beda-ab57b25e4d74 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e" status: 204 len: 0 microversion: 2.1 time: 0.225367 Jun 27 15:58:57.317470 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 548/1082] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:58:57 2022] DELETE /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:58:57.330300 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d1a1a2d6-8762-4706-9be2-c2a7ca4e4726 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:57.331794 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d1a1a2d6-8762-4706-9be2-c2a7ca4e4726 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:57.342639 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d1a1a2d6-8762-4706-9be2-c2a7ca4e4726 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:57.343451 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d1a1a2d6-8762-4706-9be2-c2a7ca4e4726 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:57.344820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d1a1a2d6-8762-4706-9be2-c2a7ca4e4726 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:57.346181 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d1a1a2d6-8762-4706-9be2-c2a7ca4e4726 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:57.499497 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d1a1a2d6-8762-4706-9be2-c2a7ca4e4726 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:57.507778 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d1a1a2d6-8762-4706-9be2-c2a7ca4e4726 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e" status: 200 len: 1680 microversion: 2.1 time: 0.185347 Jun 27 15:58:57.508371 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 535/1083] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:57 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:58:58.526612 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-41ce2cb3-504a-4a0b-ba98-08c38faf4642 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:58.527330 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-41ce2cb3-504a-4a0b-ba98-08c38faf4642 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:58.536660 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-41ce2cb3-504a-4a0b-ba98-08c38faf4642 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:58.537171 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-41ce2cb3-504a-4a0b-ba98-08c38faf4642 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:58.538176 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-41ce2cb3-504a-4a0b-ba98-08c38faf4642 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:58.538663 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-41ce2cb3-504a-4a0b-ba98-08c38faf4642 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:58.701232 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-41ce2cb3-504a-4a0b-ba98-08c38faf4642 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:58.714675 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-41ce2cb3-504a-4a0b-ba98-08c38faf4642 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e" status: 200 len: 1680 microversion: 2.1 time: 0.192541 Jun 27 15:58:58.715277 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 549/1084] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:58 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e => generated 1680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:58:59.735487 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-eeca1aca-24ef-49ce-bd89-3e2b472f54c6 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:58:59.737731 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-eeca1aca-24ef-49ce-bd89-3e2b472f54c6 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:58:59.745593 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-eeca1aca-24ef-49ce-bd89-3e2b472f54c6 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:59.746381 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-eeca1aca-24ef-49ce-bd89-3e2b472f54c6 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:59.747177 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-eeca1aca-24ef-49ce-bd89-3e2b472f54c6 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:58:59.747695 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-eeca1aca-24ef-49ce-bd89-3e2b472f54c6 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:58:59.848166 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-eeca1aca-24ef-49ce-bd89-3e2b472f54c6 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:58:59.861401 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-eeca1aca-24ef-49ce-bd89-3e2b472f54c6 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e" status: 200 len: 1613 microversion: 2.1 time: 0.130429 Jun 27 15:58:59.862807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 536/1085] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:58:59 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e => generated 1613 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:59:00.724322 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-f73d680c-e657-4499-b17d-f6f389d2386d req-28db92fc-0baf-4e40-b70f-a79fd31cbad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39e4b68-47ff-444f-b015-d9c33a70e43e", "name": "network-vif-deleted", "tag": "ab389626-c585-496d-bea8-f5b2c63a39da"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:59:00.735093 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-f73d680c-e657-4499-b17d-f6f389d2386d req-28db92fc-0baf-4e40-b70f-a79fd31cbad9 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:00.736877 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-f73d680c-e657-4499-b17d-f6f389d2386d req-28db92fc-0baf-4e40-b70f-a79fd31cbad9 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:00.751614 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-f73d680c-e657-4499-b17d-f6f389d2386d req-28db92fc-0baf-4e40-b70f-a79fd31cbad9 service nova] Creating event network-vif-deleted:ab389626-c585-496d-bea8-f5b2c63a39da for instance d39e4b68-47ff-444f-b015-d9c33a70e43e on hv-cinder-84780 Jun 27 15:59:00.757330 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-f73d680c-e657-4499-b17d-f6f389d2386d req-28db92fc-0baf-4e40-b70f-a79fd31cbad9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.373610 Jun 27 15:59:00.757994 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 550/1086] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 15:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:59:00.879048 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f2ec88e0-799e-4738-bb1f-45ff7c1c0c49 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:59:00.879681 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f2ec88e0-799e-4738-bb1f-45ff7c1c0c49 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:59:00.889213 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f2ec88e0-799e-4738-bb1f-45ff7c1c0c49 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:00.890485 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f2ec88e0-799e-4738-bb1f-45ff7c1c0c49 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:00.892385 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f2ec88e0-799e-4738-bb1f-45ff7c1c0c49 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:00.893275 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f2ec88e0-799e-4738-bb1f-45ff7c1c0c49 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:00.934136 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f2ec88e0-799e-4738-bb1f-45ff7c1c0c49 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:00.934504 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f2ec88e0-799e-4738-bb1f-45ff7c1c0c49 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:00.934979 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.objects.instance [None req-f2ec88e0-799e-4738-bb1f-45ff7c1c0c49 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lazy-loading 'fault' on Instance uuid d39e4b68-47ff-444f-b015-d9c33a70e43e {{(pid=129472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:59:01.008734 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f2ec88e0-799e-4738-bb1f-45ff7c1c0c49 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce59e0072f1c4b91a2825e5fecde7e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d9fb4d2e024e6eac7eeee72e63e904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:59:01.017660 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f2ec88e0-799e-4738-bb1f-45ff7c1c0c49 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e" status: 200 len: 1331 microversion: 2.1 time: 0.143144 Jun 27 15:59:01.018293 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 537/1087] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:59:00 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e => generated 1331 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:59:02.036612 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-5f47dc4e-f070-4897-95bf-719d5a02328a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:59:02.037453 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-5f47dc4e-f070-4897-95bf-719d5a02328a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:59:02.046951 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5f47dc4e-f070-4897-95bf-719d5a02328a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:02.047456 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5f47dc4e-f070-4897-95bf-719d5a02328a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:02.048308 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5f47dc4e-f070-4897-95bf-719d5a02328a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:02.049536 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-5f47dc4e-f070-4897-95bf-719d5a02328a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:02.066456 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-5f47dc4e-f070-4897-95bf-719d5a02328a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] HTTP exception thrown: Instance d39e4b68-47ff-444f-b015-d9c33a70e43e could not be found. Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-5f47dc4e-f070-4897-95bf-719d5a02328a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Request method failure captured: Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e HTTP/1.1 Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudKgwhUwXfk48AzZs0c5fmwwnDHGCcKPSCxkN5S5OSVIy6LsaEhk8pkOYw3Gba3WVv-Fl8yJFTEFhTCQMs2rJ8pHCHlMqrvqMWGswWTUzgomFdKB0h_BYFAabKkpg_N6pl3W9_BhGboKe81vFI9AcJFLfEjyn2HlzbkDBAwN4ZsQghM Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:59:02.068287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:59:02.070003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_90d9fb4d2e024e6eac7eeee72e63e904", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:59:02.070003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:02.070003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:59:02.070003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:02.070003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:59:02.070003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:59:02.070003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:59:02.070003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: ce59e0072f1c4b91a2825e5fecde7e23 Jun 27 15:59:02.070003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:59:02.070003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:59:02.070003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance d39e4b68-47ff-444f-b015-d9c33a70e43e could not be found. Jun 27 15:59:02.070003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': 'd39e4b68-47ff-444f-b015-d9c33a70e43e'} Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d39e4b68-47ff-444f-b015-d9c33a70e43e could not be found. Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:59:02.070959 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:59:02.072439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:59:02.072439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:59:02.072439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:59:02.072439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:59:02.072439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:59:02.072439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:59:02.072439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:59:02.072439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d39e4b68-47ff-444f-b015-d9c33a70e43e could not be found. Jun 27 15:59:02.072439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:02.072439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:59:02.072439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:02.072439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:02.072439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:59:02.072439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:59:02.072439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:59:02.072439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:59:02.072439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d39e4b68-47ff-444f-b015-d9c33a70e43e could not be found. Jun 27 15:59:02.072439 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:02.073865 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-5f47dc4e-f070-4897-95bf-719d5a02328a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Returning 404 to user: Instance d39e4b68-47ff-444f-b015-d9c33a70e43e could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:59:02.073865 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-5f47dc4e-f070-4897-95bf-719d5a02328a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e" status: 404 len: 111 microversion: 2.1 time: 0.039218 Jun 27 15:59:02.073865 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 551/1088] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:59:02 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:59:02.082064 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f8ad01e5-6074-4c13-9648-bfd220f9204c tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '.version_select at 0x7fe145fd3e50>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:59:02.102670 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f8ad01e5-6074-4c13-9648-bfd220f9204c tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1867998651" status: 202 len: 0 microversion: 2.1 time: 0.024992 Jun 27 15:59:02.103515 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 538/1089] 10.222.0.20 () {58 vars in 1220 bytes} [Mon Jun 27 15:59:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1867998651 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:59:03.972525 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-33929f11-eaaa-4380-befb-d8c514fdb46e tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:59:03.973146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-33929f11-eaaa-4380-befb-d8c514fdb46e tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:59:03.980306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-33929f11-eaaa-4380-befb-d8c514fdb46e tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:03.980754 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-33929f11-eaaa-4380-befb-d8c514fdb46e tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:03.981713 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-33929f11-eaaa-4380-befb-d8c514fdb46e tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:03.982164 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-33929f11-eaaa-4380-befb-d8c514fdb46e tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:04.000241 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-33929f11-eaaa-4380-befb-d8c514fdb46e tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] HTTP exception thrown: Instance d39e4b68-47ff-444f-b015-d9c33a70e43e could not be found. Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-33929f11-eaaa-4380-befb-d8c514fdb46e tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Request method failure captured: Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: DELETE /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e HTTP/1.1 Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudKgwhUwXfk48AzZs0c5fmwwnDHGCcKPSCxkN5S5OSVIy6LsaEhk8pkOYw3Gba3WVv-Fl8yJFTEFhTCQMs2rJ8pHCHlMqrvqMWGswWTUzgomFdKB0h_BYFAabKkpg_N6pl3W9_BhGboKe81vFI9AcJFLfEjyn2HlzbkDBAwN4ZsQghM Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:59:04.003189 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:59:04.004863 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_90d9fb4d2e024e6eac7eeee72e63e904", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:59:04.004863 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:04.004863 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:59:04.004863 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:04.004863 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:59:04.004863 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:59:04.004863 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:59:04.004863 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: ce59e0072f1c4b91a2825e5fecde7e23 Jun 27 15:59:04.004863 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:59:04.004863 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:59:04.004863 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance d39e4b68-47ff-444f-b015-d9c33a70e43e could not be found. Jun 27 15:59:04.004863 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': 'd39e4b68-47ff-444f-b015-d9c33a70e43e'} Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d39e4b68-47ff-444f-b015-d9c33a70e43e could not be found. Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:59:04.005740 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d39e4b68-47ff-444f-b015-d9c33a70e43e could not be found. Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d39e4b68-47ff-444f-b015-d9c33a70e43e could not be found. Jun 27 15:59:04.007035 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:04.008333 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-33929f11-eaaa-4380-befb-d8c514fdb46e tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Returning 404 to user: Instance d39e4b68-47ff-444f-b015-d9c33a70e43e could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:59:04.008333 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-33929f11-eaaa-4380-befb-d8c514fdb46e tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e" status: 404 len: 111 microversion: 2.1 time: 0.036757 Jun 27 15:59:04.008333 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 552/1090] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:59:03 2022] DELETE /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:59:04.015390 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ab40ddee-7c34-4806-8d71-649e662fd7b9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:59:04.016001 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-ab40ddee-7c34-4806-8d71-649e662fd7b9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: d39e4b68-47ff-444f-b015-d9c33a70e43e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:59:04.023841 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ab40ddee-7c34-4806-8d71-649e662fd7b9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:04.024359 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ab40ddee-7c34-4806-8d71-649e662fd7b9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:04.025123 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ab40ddee-7c34-4806-8d71-649e662fd7b9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:04.025556 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ab40ddee-7c34-4806-8d71-649e662fd7b9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:04.041870 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-ab40ddee-7c34-4806-8d71-649e662fd7b9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] HTTP exception thrown: Instance d39e4b68-47ff-444f-b015-d9c33a70e43e could not be found. Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ab40ddee-7c34-4806-8d71-649e662fd7b9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Request method failure captured: Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e HTTP/1.1 Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudKgwhUwXfk48AzZs0c5fmwwnDHGCcKPSCxkN5S5OSVIy6LsaEhk8pkOYw3Gba3WVv-Fl8yJFTEFhTCQMs2rJ8pHCHlMqrvqMWGswWTUzgomFdKB0h_BYFAabKkpg_N6pl3W9_BhGboKe81vFI9AcJFLfEjyn2HlzbkDBAwN4ZsQghM Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:59:04.044191 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:59:04.046412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_90d9fb4d2e024e6eac7eeee72e63e904", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:59:04.046412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:04.046412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:59:04.046412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:04.046412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:59:04.046412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:59:04.046412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:59:04.046412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: ce59e0072f1c4b91a2825e5fecde7e23 Jun 27 15:59:04.046412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:59:04.046412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:59:04.046412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance d39e4b68-47ff-444f-b015-d9c33a70e43e could not be found. Jun 27 15:59:04.046412 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': 'd39e4b68-47ff-444f-b015-d9c33a70e43e'} Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d39e4b68-47ff-444f-b015-d9c33a70e43e could not be found. Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:59:04.047225 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:59:04.049730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:59:04.049730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:59:04.049730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:59:04.049730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:59:04.049730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:59:04.049730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:59:04.049730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:59:04.049730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d39e4b68-47ff-444f-b015-d9c33a70e43e could not be found. Jun 27 15:59:04.049730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:04.049730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:59:04.049730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:04.049730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:04.049730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:59:04.049730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:59:04.049730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:59:04.049730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:59:04.049730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d39e4b68-47ff-444f-b015-d9c33a70e43e could not be found. Jun 27 15:59:04.049730 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:04.051155 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ab40ddee-7c34-4806-8d71-649e662fd7b9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Returning 404 to user: Instance d39e4b68-47ff-444f-b015-d9c33a70e43e could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:59:04.051155 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ab40ddee-7c34-4806-8d71-649e662fd7b9 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e" status: 404 len: 111 microversion: 2.1 time: 0.036720 Jun 27 15:59:04.051155 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 539/1091] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:59:04 2022] GET /compute/v2.1/servers/d39e4b68-47ff-444f-b015-d9c33a70e43e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:59:05.212555 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-bdf56187-4410-445d-9c82-ab7d05b8de8d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:59:05.213184 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-bdf56187-4410-445d-9c82-ab7d05b8de8d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:59:05.221225 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bdf56187-4410-445d-9c82-ab7d05b8de8d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:05.221707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bdf56187-4410-445d-9c82-ab7d05b8de8d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:05.222535 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bdf56187-4410-445d-9c82-ab7d05b8de8d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:05.222975 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bdf56187-4410-445d-9c82-ab7d05b8de8d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:05.238929 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-bdf56187-4410-445d-9c82-ab7d05b8de8d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] HTTP exception thrown: Instance e3facdf2-b6fd-4e91-beb1-3eda459500ff could not be found. Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-bdf56187-4410-445d-9c82-ab7d05b8de8d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Request method failure captured: Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: DELETE /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff HTTP/1.1 Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudKgwhUwXfk48AzZs0c5fmwwnDHGCcKPSCxkN5S5OSVIy6LsaEhk8pkOYw3Gba3WVv-Fl8yJFTEFhTCQMs2rJ8pHCHlMqrvqMWGswWTUzgomFdKB0h_BYFAabKkpg_N6pl3W9_BhGboKe81vFI9AcJFLfEjyn2HlzbkDBAwN4ZsQghM Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:59:05.240546 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:59:05.242306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_90d9fb4d2e024e6eac7eeee72e63e904", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:59:05.242306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:05.242306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:59:05.242306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:05.242306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:59:05.242306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:59:05.242306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:59:05.242306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: ce59e0072f1c4b91a2825e5fecde7e23 Jun 27 15:59:05.242306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:59:05.242306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:59:05.242306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance e3facdf2-b6fd-4e91-beb1-3eda459500ff could not be found. Jun 27 15:59:05.242306 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': 'e3facdf2-b6fd-4e91-beb1-3eda459500ff'} Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3facdf2-b6fd-4e91-beb1-3eda459500ff could not be found. Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:59:05.243490 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3facdf2-b6fd-4e91-beb1-3eda459500ff could not be found. Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3facdf2-b6fd-4e91-beb1-3eda459500ff could not be found. Jun 27 15:59:05.245147 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.247297 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-bdf56187-4410-445d-9c82-ab7d05b8de8d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Returning 404 to user: Instance e3facdf2-b6fd-4e91-beb1-3eda459500ff could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:59:05.247297 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-bdf56187-4410-445d-9c82-ab7d05b8de8d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff" status: 404 len: 111 microversion: 2.1 time: 0.033987 Jun 27 15:59:05.247297 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 553/1092] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:59:05 2022] DELETE /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:59:05.250720 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3fcf7566-33e5-4d6c-99f8-2114727db702 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:59:05.251964 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3fcf7566-33e5-4d6c-99f8-2114727db702 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: e3facdf2-b6fd-4e91-beb1-3eda459500ff] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:59:05.258819 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3fcf7566-33e5-4d6c-99f8-2114727db702 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:05.259270 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3fcf7566-33e5-4d6c-99f8-2114727db702 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:05.260055 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3fcf7566-33e5-4d6c-99f8-2114727db702 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:05.260488 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3fcf7566-33e5-4d6c-99f8-2114727db702 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:05.276641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-3fcf7566-33e5-4d6c-99f8-2114727db702 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] HTTP exception thrown: Instance e3facdf2-b6fd-4e91-beb1-3eda459500ff could not be found. Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3fcf7566-33e5-4d6c-99f8-2114727db702 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Request method failure captured: Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff HTTP/1.1 Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudKgwhUwXfk48AzZs0c5fmwwnDHGCcKPSCxkN5S5OSVIy6LsaEhk8pkOYw3Gba3WVv-Fl8yJFTEFhTCQMs2rJ8pHCHlMqrvqMWGswWTUzgomFdKB0h_BYFAabKkpg_N6pl3W9_BhGboKe81vFI9AcJFLfEjyn2HlzbkDBAwN4ZsQghM Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:59:05.278223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:59:05.280260 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_90d9fb4d2e024e6eac7eeee72e63e904", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:59:05.280260 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:05.280260 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:59:05.280260 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:05.280260 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:59:05.280260 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:59:05.280260 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:59:05.280260 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: ce59e0072f1c4b91a2825e5fecde7e23 Jun 27 15:59:05.280260 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:59:05.280260 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:59:05.280260 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance e3facdf2-b6fd-4e91-beb1-3eda459500ff could not be found. Jun 27 15:59:05.280260 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': 'e3facdf2-b6fd-4e91-beb1-3eda459500ff'} Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3facdf2-b6fd-4e91-beb1-3eda459500ff could not be found. Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:59:05.281606 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:59:05.285306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:59:05.285306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:59:05.285306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:59:05.285306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:59:05.285306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:59:05.285306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:59:05.285306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:59:05.285306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3facdf2-b6fd-4e91-beb1-3eda459500ff could not be found. Jun 27 15:59:05.285306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.285306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:59:05.285306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.285306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:05.285306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:59:05.285306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:59:05.285306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:59:05.285306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:59:05.285306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3facdf2-b6fd-4e91-beb1-3eda459500ff could not be found. Jun 27 15:59:05.285306 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.287355 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3fcf7566-33e5-4d6c-99f8-2114727db702 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Returning 404 to user: Instance e3facdf2-b6fd-4e91-beb1-3eda459500ff could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:59:05.287355 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3fcf7566-33e5-4d6c-99f8-2114727db702 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff" status: 404 len: 111 microversion: 2.1 time: 0.032818 Jun 27 15:59:05.287355 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 540/1093] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:59:05 2022] GET /compute/v2.1/servers/e3facdf2-b6fd-4e91-beb1-3eda459500ff => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:59:05.289052 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-056aa8b4-1ba0-44d2-b8fc-159e9f3b104d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:59:05.289557 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-056aa8b4-1ba0-44d2-b8fc-159e9f3b104d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:59:05.296246 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-056aa8b4-1ba0-44d2-b8fc-159e9f3b104d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:05.296684 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-056aa8b4-1ba0-44d2-b8fc-159e9f3b104d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:05.297457 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-056aa8b4-1ba0-44d2-b8fc-159e9f3b104d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:05.297964 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-056aa8b4-1ba0-44d2-b8fc-159e9f3b104d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:05.315015 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-056aa8b4-1ba0-44d2-b8fc-159e9f3b104d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] HTTP exception thrown: Instance 8f94baae-848b-491b-ba4e-56149f83856e could not be found. Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-056aa8b4-1ba0-44d2-b8fc-159e9f3b104d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Request method failure captured: Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: DELETE /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e HTTP/1.1 Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudKgwhUwXfk48AzZs0c5fmwwnDHGCcKPSCxkN5S5OSVIy6LsaEhk8pkOYw3Gba3WVv-Fl8yJFTEFhTCQMs2rJ8pHCHlMqrvqMWGswWTUzgomFdKB0h_BYFAabKkpg_N6pl3W9_BhGboKe81vFI9AcJFLfEjyn2HlzbkDBAwN4ZsQghM Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:59:05.316198 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:59:05.318275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_90d9fb4d2e024e6eac7eeee72e63e904", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:59:05.318275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:05.318275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:59:05.318275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:05.318275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:59:05.318275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:59:05.318275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:59:05.318275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: ce59e0072f1c4b91a2825e5fecde7e23 Jun 27 15:59:05.318275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:59:05.318275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:59:05.318275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance 8f94baae-848b-491b-ba4e-56149f83856e could not be found. Jun 27 15:59:05.318275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': '8f94baae-848b-491b-ba4e-56149f83856e'} Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f94baae-848b-491b-ba4e-56149f83856e could not be found. Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:59:05.319372 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f94baae-848b-491b-ba4e-56149f83856e could not be found. Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f94baae-848b-491b-ba4e-56149f83856e could not be found. Jun 27 15:59:05.321109 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.322876 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-056aa8b4-1ba0-44d2-b8fc-159e9f3b104d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Returning 404 to user: Instance 8f94baae-848b-491b-ba4e-56149f83856e could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:59:05.322876 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-056aa8b4-1ba0-44d2-b8fc-159e9f3b104d tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 404 len: 111 microversion: 2.1 time: 0.032583 Jun 27 15:59:05.322876 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 554/1094] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:59:05 2022] DELETE /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:59:05.327171 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ea282833-dafa-4744-97ec-e80d77a5650a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:59:05.327820 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-ea282833-dafa-4744-97ec-e80d77a5650a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: 8f94baae-848b-491b-ba4e-56149f83856e] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:59:05.334345 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ea282833-dafa-4744-97ec-e80d77a5650a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:05.334795 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ea282833-dafa-4744-97ec-e80d77a5650a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:05.335585 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ea282833-dafa-4744-97ec-e80d77a5650a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:05.336201 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ea282833-dafa-4744-97ec-e80d77a5650a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:05.351114 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-ea282833-dafa-4744-97ec-e80d77a5650a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] HTTP exception thrown: Instance 8f94baae-848b-491b-ba4e-56149f83856e could not be found. Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ea282833-dafa-4744-97ec-e80d77a5650a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Request method failure captured: Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e HTTP/1.1 Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudKgwhUwXfk48AzZs0c5fmwwnDHGCcKPSCxkN5S5OSVIy6LsaEhk8pkOYw3Gba3WVv-Fl8yJFTEFhTCQMs2rJ8pHCHlMqrvqMWGswWTUzgomFdKB0h_BYFAabKkpg_N6pl3W9_BhGboKe81vFI9AcJFLfEjyn2HlzbkDBAwN4ZsQghM Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:59:05.352675 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:59:05.354871 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_90d9fb4d2e024e6eac7eeee72e63e904", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:59:05.354871 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:05.354871 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:59:05.354871 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:05.354871 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:59:05.354871 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:59:05.354871 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:59:05.354871 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: ce59e0072f1c4b91a2825e5fecde7e23 Jun 27 15:59:05.354871 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:59:05.354871 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:59:05.354871 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance 8f94baae-848b-491b-ba4e-56149f83856e could not be found. Jun 27 15:59:05.354871 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': '8f94baae-848b-491b-ba4e-56149f83856e'} Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f94baae-848b-491b-ba4e-56149f83856e could not be found. Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:59:05.356089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:59:05.358333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:59:05.358333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:59:05.358333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:59:05.358333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:59:05.358333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:59:05.358333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:59:05.358333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:59:05.358333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f94baae-848b-491b-ba4e-56149f83856e could not be found. Jun 27 15:59:05.358333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.358333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:59:05.358333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.358333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:05.358333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:59:05.358333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:59:05.358333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:59:05.358333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:59:05.358333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f94baae-848b-491b-ba4e-56149f83856e could not be found. Jun 27 15:59:05.358333 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:05.359662 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ea282833-dafa-4744-97ec-e80d77a5650a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Returning 404 to user: Instance 8f94baae-848b-491b-ba4e-56149f83856e could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:59:05.359662 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ea282833-dafa-4744-97ec-e80d77a5650a tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e" status: 404 len: 111 microversion: 2.1 time: 0.031440 Jun 27 15:59:05.359662 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 541/1095] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:59:05 2022] GET /compute/v2.1/servers/8f94baae-848b-491b-ba4e-56149f83856e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:59:06.520298 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b865dfcd-d4f4-4eb2-8a1a-379095336935 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:59:06.520882 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b865dfcd-d4f4-4eb2-8a1a-379095336935 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:59:06.527634 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b865dfcd-d4f4-4eb2-8a1a-379095336935 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:06.528077 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b865dfcd-d4f4-4eb2-8a1a-379095336935 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:06.528842 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b865dfcd-d4f4-4eb2-8a1a-379095336935 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:06.529275 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b865dfcd-d4f4-4eb2-8a1a-379095336935 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:06.543599 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.wsgi [None req-b865dfcd-d4f4-4eb2-8a1a-379095336935 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] HTTP exception thrown: Instance f74d93df-6aac-45ba-83a0-4bafe2c375aa could not be found. Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b865dfcd-d4f4-4eb2-8a1a-379095336935 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Request method failure captured: Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: request: DELETE /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa HTTP/1.1 Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept: application/json Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Accept-Encoding: identity Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Connection: close Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Length: 0 Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Content-Type: application/json Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Host: 10.222.0.20 Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Openstack-System-Scope: None Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: User-Agent: python-urllib3/1.26.9 Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Auth-Token: gAAAAABiudKgwhUwXfk48AzZs0c5fmwwnDHGCcKPSCxkN5S5OSVIy6LsaEhk8pkOYw3Gba3WVv-Fl8yJFTEFhTCQMs2rJ8pHCHlMqrvqMWGswWTUzgomFdKB0h_BYFAabKkpg_N6pl3W9_BhGboKe81vFI9AcJFLfEjyn2HlzbkDBAwN4ZsQghM Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Id: None Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Domain-Name: None Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Identity-Status: Confirmed Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Is-Admin-Project: True Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Id: default Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Domain-Name: Default Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Project-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Role: reader,member Jun 27 15:59:06.545175 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Roles: reader,member Jun 27 15:59:06.547071 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_90d9fb4d2e024e6eac7eeee72e63e904", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:59:06.547071 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:06.547071 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:59:06.547071 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:06.547071 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:59:06.547071 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Id: default Jun 27 15:59:06.547071 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Domain-Name: Default Jun 27 15:59:06.547071 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Id: ce59e0072f1c4b91a2825e5fecde7e23 Jun 27 15:59:06.547071 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: X-User-Name: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:59:06.547071 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: method: > Jun 27 15:59:06.547071 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: exception: Instance f74d93df-6aac-45ba-83a0-4bafe2c375aa could not be found. Jun 27 15:59:06.547071 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: action_args: {'id': 'f74d93df-6aac-45ba-83a0-4bafe2c375aa'} Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f74d93df-6aac-45ba-83a0-4bafe2c375aa could not be found. Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:59:06.548016 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f74d93df-6aac-45ba-83a0-4bafe2c375aa could not be found. Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f74d93df-6aac-45ba-83a0-4bafe2c375aa could not be found. Jun 27 15:59:06.550910 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: ERROR nova.api.openstack.wsgi Jun 27 15:59:06.552799 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b865dfcd-d4f4-4eb2-8a1a-379095336935 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Returning 404 to user: Instance f74d93df-6aac-45ba-83a0-4bafe2c375aa could not be found. {{(pid=129473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:59:06.552799 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b865dfcd-d4f4-4eb2-8a1a-379095336935 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 404 len: 111 microversion: 2.1 time: 0.031318 Jun 27 15:59:06.552799 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 555/1096] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 15:59:06 2022] DELETE /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:59:06.556057 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c6da1fb2-5a92-443b-9a9f-08874a567d91 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:59:06.556671 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c6da1fb2-5a92-443b-9a9f-08874a567d91 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] [instance: f74d93df-6aac-45ba-83a0-4bafe2c375aa] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:59:06.563446 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c6da1fb2-5a92-443b-9a9f-08874a567d91 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:06.564537 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c6da1fb2-5a92-443b-9a9f-08874a567d91 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:06.565207 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c6da1fb2-5a92-443b-9a9f-08874a567d91 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:59:06.565838 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c6da1fb2-5a92-443b-9a9f-08874a567d91 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:59:06.582194 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-c6da1fb2-5a92-443b-9a9f-08874a567d91 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] HTTP exception thrown: Instance f74d93df-6aac-45ba-83a0-4bafe2c375aa could not be found. Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c6da1fb2-5a92-443b-9a9f-08874a567d91 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Request method failure captured: Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa HTTP/1.1 Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudKgwhUwXfk48AzZs0c5fmwwnDHGCcKPSCxkN5S5OSVIy6LsaEhk8pkOYw3Gba3WVv-Fl8yJFTEFhTCQMs2rJ8pHCHlMqrvqMWGswWTUzgomFdKB0h_BYFAabKkpg_N6pl3W9_BhGboKe81vFI9AcJFLfEjyn2HlzbkDBAwN4ZsQghM Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 15:59:06.583737 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 15:59:06.585472 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90d9fb4d2e024e6eac7eeee72e63e904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_90d9fb4d2e024e6eac7eeee72e63e904", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 15:59:06.585472 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:06.585472 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 90d9fb4d2e024e6eac7eeee72e63e904 Jun 27 15:59:06.585472 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-226989103 Jun 27 15:59:06.585472 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:59:06.585472 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 15:59:06.585472 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 15:59:06.585472 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: ce59e0072f1c4b91a2825e5fecde7e23 Jun 27 15:59:06.585472 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-AttachVolumeNegativeTest-226989103-project Jun 27 15:59:06.585472 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 15:59:06.585472 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance f74d93df-6aac-45ba-83a0-4bafe2c375aa could not be found. Jun 27 15:59:06.585472 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': 'f74d93df-6aac-45ba-83a0-4bafe2c375aa'} Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f74d93df-6aac-45ba-83a0-4bafe2c375aa could not be found. Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:59:06.586674 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:59:06.588197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:59:06.588197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:59:06.588197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:59:06.588197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:59:06.588197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:59:06.588197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:59:06.588197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:59:06.588197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f74d93df-6aac-45ba-83a0-4bafe2c375aa could not be found. Jun 27 15:59:06.588197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:06.588197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:59:06.588197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:06.588197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:59:06.588197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:59:06.588197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:59:06.588197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:59:06.588197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:59:06.588197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f74d93df-6aac-45ba-83a0-4bafe2c375aa could not be found. Jun 27 15:59:06.588197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 15:59:06.589826 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c6da1fb2-5a92-443b-9a9f-08874a567d91 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] Returning 404 to user: Instance f74d93df-6aac-45ba-83a0-4bafe2c375aa could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:59:06.589826 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c6da1fb2-5a92-443b-9a9f-08874a567d91 tempest-AttachVolumeNegativeTest-226989103 tempest-AttachVolumeNegativeTest-226989103-project] 10.222.0.20 "GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa" status: 404 len: 111 microversion: 2.1 time: 0.033248 Jun 27 15:59:06.589826 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 542/1097] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 15:59:06 2022] GET /compute/v2.1/servers/f74d93df-6aac-45ba-83a0-4bafe2c375aa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 16:00:16.396186 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:00:16.397607 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:00:16.864008 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-fd2b4979-ebba-4214-afc9-be8f67026426 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Action: 'create', calling method: .version_select at 0x7fe14650fe50>, body: {"keypair": {"name": "tempest-TestShelveInstance-167746861", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLT0qqNqH8VvP1qIhwrFf46imHA44gIBXUmD3adCDR/hxJoxw/FKIS7OWtG8iCd7H1mP759iemuR06Rzkxr8EQIJ1xcP8PXKd+syUBoeY8zXQqASIKFK5HVxlh94xsNYnQ=="}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 16:00:16.879051 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-fd2b4979-ebba-4214-afc9-be8f67026426 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Getting quotas for project 636c72ef28514ac5aef5779a137d9df7. Resources: {'key_pairs'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 16:00:16.883403 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.quota [None req-fd2b4979-ebba-4214-afc9-be8f67026426 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Getting quotas for user bffd1a8597e94f69b1bd98bd6ea7b294 and project 636c72ef28514ac5aef5779a137d9df7. Resources: {'key_pairs'} {{(pid=129473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 16:00:16.909075 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-fd2b4979-ebba-4214-afc9-be8f67026426 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.515101 Jun 27 16:00:16.909883 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 556/1098] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Jun 27 16:00:16 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 16:00:32.618325 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:00:32.619228 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:00:32.623513 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3912c3f1-ede6-4c2a-9680-7619e1d4233f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-243553567", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-167746861", "security_groups": [{"name": "tempest-secgroup-smoke-669214492"}], "networks": [{"uuid": "52f9df87-b991-4b07-9621-55e89f7556e3"}], "block_device_mapping_v2": [{"uuid": "fa3101a8-6132-4876-bf33-4c0c7e756e58", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 16:00:32.756327 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.network.neutron [None req-3912c3f1-ede6-4c2a-9680-7619e1d4233f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] validate_networks() for [('52f9df87-b991-4b07-9621-55e89f7556e3', None, None, None, None, None)] {{(pid=129472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 16:00:33.276279 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-3912c3f1-ede6-4c2a-9680-7619e1d4233f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Flavor limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 16:00:33.276704 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-3912c3f1-ede6-4c2a-9680-7619e1d4233f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Image limits 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 16:00:33.277179 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-3912c3f1-ede6-4c2a-9680-7619e1d4233f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Flavor pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 16:00:33.277586 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-3912c3f1-ede6-4c2a-9680-7619e1d4233f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Image pref 0:0:0 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 16:00:33.278260 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.virt.hardware [None req-3912c3f1-ede6-4c2a-9680-7619e1d4233f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 16:00:33.289217 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3912c3f1-ede6-4c2a-9680-7619e1d4233f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:33.289679 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3912c3f1-ede6-4c2a-9680-7619e1d4233f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:33.290526 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3912c3f1-ede6-4c2a-9680-7619e1d4233f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:33.290971 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3912c3f1-ede6-4c2a-9680-7619e1d4233f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:33.309574 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-3912c3f1-ede6-4c2a-9680-7619e1d4233f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Getting quotas for project 636c72ef28514ac5aef5779a137d9df7. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 16:00:33.316012 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.quota [None req-3912c3f1-ede6-4c2a-9680-7619e1d4233f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Getting quotas for user bffd1a8597e94f69b1bd98bd6ea7b294 and project 636c72ef28514ac5aef5779a137d9df7. Resources: {'ram', 'cores', 'instances'} {{(pid=129472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 16:00:33.378857 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3912c3f1-ede6-4c2a-9680-7619e1d4233f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Going to run 1 instances... {{(pid=129472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 16:00:33.380976 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3912c3f1-ede6-4c2a-9680-7619e1d4233f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa3101a8-6132-4876-bf33-4c0c7e756e58',volume_size=None,volume_type=None)] {{(pid=129472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 16:00:33.539854 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3912c3f1-ede6-4c2a-9680-7619e1d4233f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.923312 Jun 27 16:00:33.540596 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 543/1099] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jun 27 16:00:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 16:00:33.550449 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=4 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:00:33.552159 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:00:33.561581 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-12e89935-d267-439c-89d0-78f336e9ae0e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:00:33.563408 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-12e89935-d267-439c-89d0-78f336e9ae0e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:00:33.626901 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-12e89935-d267-439c-89d0-78f336e9ae0e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:00:33.634823 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-12e89935-d267-439c-89d0-78f336e9ae0e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1087 microversion: 2.1 time: 0.086422 Jun 27 16:00:33.635394 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 557/1100] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:00:33 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1087 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:00:34.653197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-abf862a2-026c-4be1-b82b-07beace20722 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:00:34.653864 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-abf862a2-026c-4be1-b82b-07beace20722 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:00:34.661379 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-abf862a2-026c-4be1-b82b-07beace20722 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:34.661859 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-abf862a2-026c-4be1-b82b-07beace20722 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:34.662702 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-abf862a2-026c-4be1-b82b-07beace20722 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:34.663140 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-abf862a2-026c-4be1-b82b-07beace20722 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:34.728197 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-abf862a2-026c-4be1-b82b-07beace20722 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:00:34.737077 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-abf862a2-026c-4be1-b82b-07beace20722 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1185 microversion: 2.1 time: 0.088437 Jun 27 16:00:34.737670 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 544/1101] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:00:34 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:00:35.753797 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-395ce67b-b817-4a52-8303-439a6591ebca tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:00:35.754583 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-395ce67b-b817-4a52-8303-439a6591ebca tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:00:35.761296 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-395ce67b-b817-4a52-8303-439a6591ebca tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:35.761921 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-395ce67b-b817-4a52-8303-439a6591ebca tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:35.762809 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-395ce67b-b817-4a52-8303-439a6591ebca tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:35.763349 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-395ce67b-b817-4a52-8303-439a6591ebca tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:35.920408 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-395ce67b-b817-4a52-8303-439a6591ebca tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:00:35.929707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-395ce67b-b817-4a52-8303-439a6591ebca tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1258 microversion: 2.1 time: 0.179844 Jun 27 16:00:35.930389 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 558/1102] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:00:35 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:00:36.303441 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-1a34e99e-b311-45d2-a7fa-4f60e45c9b37 req-23ebf402-04ed-46e8-aecc-25c9ef6e5691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d68a32-ff52-4f19-accc-6c55798545ec", "tag": "ec6488b0-831b-486e-a2ba-6bed5cd24ff0"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 16:00:36.332840 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-1a34e99e-b311-45d2-a7fa-4f60e45c9b37 req-23ebf402-04ed-46e8-aecc-25c9ef6e5691 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:36.333285 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-1a34e99e-b311-45d2-a7fa-4f60e45c9b37 req-23ebf402-04ed-46e8-aecc-25c9ef6e5691 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:36.346532 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-1a34e99e-b311-45d2-a7fa-4f60e45c9b37 req-23ebf402-04ed-46e8-aecc-25c9ef6e5691 service nova] Creating event network-changed:ec6488b0-831b-486e-a2ba-6bed5cd24ff0 for instance 20d68a32-ff52-4f19-accc-6c55798545ec on hv-cinder-84780 Jun 27 16:00:36.352440 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-1a34e99e-b311-45d2-a7fa-4f60e45c9b37 req-23ebf402-04ed-46e8-aecc-25c9ef6e5691 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065933 Jun 27 16:00:36.354184 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 545/1103] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 16:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 16:00:36.952635 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-40f1a9cc-8145-4db5-97d8-7bf63f1019b0 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:00:36.953239 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-40f1a9cc-8145-4db5-97d8-7bf63f1019b0 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:00:36.959678 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-40f1a9cc-8145-4db5-97d8-7bf63f1019b0 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:36.960122 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-40f1a9cc-8145-4db5-97d8-7bf63f1019b0 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:36.960878 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-40f1a9cc-8145-4db5-97d8-7bf63f1019b0 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:36.961302 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-40f1a9cc-8145-4db5-97d8-7bf63f1019b0 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:37.096236 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-40f1a9cc-8145-4db5-97d8-7bf63f1019b0 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:00:37.103847 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-40f1a9cc-8145-4db5-97d8-7bf63f1019b0 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1258 microversion: 2.1 time: 0.155367 Jun 27 16:00:37.104414 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 559/1104] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:00:36 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:00:38.122260 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-80389e90-46a8-4da6-a583-34e00ed593b8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:00:38.122969 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-80389e90-46a8-4da6-a583-34e00ed593b8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:00:38.130967 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-80389e90-46a8-4da6-a583-34e00ed593b8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:38.131417 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-80389e90-46a8-4da6-a583-34e00ed593b8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:38.132206 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-80389e90-46a8-4da6-a583-34e00ed593b8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:38.132654 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-80389e90-46a8-4da6-a583-34e00ed593b8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:38.283158 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-80389e90-46a8-4da6-a583-34e00ed593b8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:00:38.291212 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-80389e90-46a8-4da6-a583-34e00ed593b8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1258 microversion: 2.1 time: 0.173486 Jun 27 16:00:38.291834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 546/1105] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:00:38 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 16:00:39.310803 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-b977f44f-d77d-4b26-870a-c0f0ed01e8e3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:00:39.311509 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-b977f44f-d77d-4b26-870a-c0f0ed01e8e3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:00:39.318223 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b977f44f-d77d-4b26-870a-c0f0ed01e8e3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:39.318671 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b977f44f-d77d-4b26-870a-c0f0ed01e8e3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:39.319450 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b977f44f-d77d-4b26-870a-c0f0ed01e8e3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:39.319876 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-b977f44f-d77d-4b26-870a-c0f0ed01e8e3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:39.453065 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-b977f44f-d77d-4b26-870a-c0f0ed01e8e3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:00:39.461149 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-b977f44f-d77d-4b26-870a-c0f0ed01e8e3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1258 microversion: 2.1 time: 0.154135 Jun 27 16:00:39.461751 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 560/1106] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:00:39 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:00:40.479036 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9cd73772-cd14-4a69-b4ed-85ca9dc04757 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:00:40.479678 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9cd73772-cd14-4a69-b4ed-85ca9dc04757 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:00:40.487325 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9cd73772-cd14-4a69-b4ed-85ca9dc04757 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:40.487779 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9cd73772-cd14-4a69-b4ed-85ca9dc04757 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:40.488552 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9cd73772-cd14-4a69-b4ed-85ca9dc04757 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:40.489010 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9cd73772-cd14-4a69-b4ed-85ca9dc04757 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:40.636724 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9cd73772-cd14-4a69-b4ed-85ca9dc04757 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:00:40.645118 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9cd73772-cd14-4a69-b4ed-85ca9dc04757 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1258 microversion: 2.1 time: 0.170066 Jun 27 16:00:40.645729 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 547/1107] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:00:40 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:00:41.662359 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-2e505929-c70b-465d-8f59-d59925e15dc2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:00:41.663101 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-2e505929-c70b-465d-8f59-d59925e15dc2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:00:41.672808 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2e505929-c70b-465d-8f59-d59925e15dc2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:41.673258 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2e505929-c70b-465d-8f59-d59925e15dc2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:41.674179 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2e505929-c70b-465d-8f59-d59925e15dc2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:41.676427 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-2e505929-c70b-465d-8f59-d59925e15dc2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:41.824895 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-2e505929-c70b-465d-8f59-d59925e15dc2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:00:41.833921 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-2e505929-c70b-465d-8f59-d59925e15dc2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1258 microversion: 2.1 time: 0.175556 Jun 27 16:00:41.834561 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 561/1108] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:00:41 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:00:42.852629 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9257da35-b282-4d8b-ba9d-24e6eef4059e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:00:42.853364 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9257da35-b282-4d8b-ba9d-24e6eef4059e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:00:42.861233 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9257da35-b282-4d8b-ba9d-24e6eef4059e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:42.861703 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9257da35-b282-4d8b-ba9d-24e6eef4059e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:42.862499 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9257da35-b282-4d8b-ba9d-24e6eef4059e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:42.862933 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9257da35-b282-4d8b-ba9d-24e6eef4059e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:43.022760 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-9257da35-b282-4d8b-ba9d-24e6eef4059e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:00:43.032616 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9257da35-b282-4d8b-ba9d-24e6eef4059e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1258 microversion: 2.1 time: 0.183949 Jun 27 16:00:43.033231 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 548/1109] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:00:42 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1258 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 16:00:44.050287 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-7529c5e4-a5f4-44e0-9002-760339f157ba tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:00:44.050889 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-7529c5e4-a5f4-44e0-9002-760339f157ba tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:00:44.053371 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell0:SELECT=2 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:00:44.058969 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7529c5e4-a5f4-44e0-9002-760339f157ba tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:44.059420 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7529c5e4-a5f4-44e0-9002-760339f157ba tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:44.060212 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7529c5e4-a5f4-44e0-9002-760339f157ba tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:44.060866 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-7529c5e4-a5f4-44e0-9002-760339f157ba tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:44.198220 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-7529c5e4-a5f4-44e0-9002-760339f157ba tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:00:44.206878 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-7529c5e4-a5f4-44e0-9002-760339f157ba tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1258 microversion: 2.1 time: 0.160820 Jun 27 16:00:44.207470 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 562/1110] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:00:44 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:00:45.226407 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-825340b8-9fb8-4c70-919c-cf5db32d01e5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:00:45.227157 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-825340b8-9fb8-4c70-919c-cf5db32d01e5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:00:45.229615 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=2 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:00:45.230314 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell0:SELECT=6 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:00:45.238756 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-825340b8-9fb8-4c70-919c-cf5db32d01e5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:45.239207 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-825340b8-9fb8-4c70-919c-cf5db32d01e5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:45.240024 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-825340b8-9fb8-4c70-919c-cf5db32d01e5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:45.240464 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-825340b8-9fb8-4c70-919c-cf5db32d01e5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:45.393274 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-825340b8-9fb8-4c70-919c-cf5db32d01e5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:00:45.401259 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-825340b8-9fb8-4c70-919c-cf5db32d01e5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1258 microversion: 2.1 time: 0.180198 Jun 27 16:00:45.401900 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 549/1111] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:00:45 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1258 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:00:46.426731 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-22b56589-cbb5-40e7-a85a-1e422b9f5ad7 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:00:46.427612 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-22b56589-cbb5-40e7-a85a-1e422b9f5ad7 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:00:46.435352 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-22b56589-cbb5-40e7-a85a-1e422b9f5ad7 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:46.435810 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-22b56589-cbb5-40e7-a85a-1e422b9f5ad7 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:46.437405 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-22b56589-cbb5-40e7-a85a-1e422b9f5ad7 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:46.438238 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-22b56589-cbb5-40e7-a85a-1e422b9f5ad7 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:46.586851 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-22b56589-cbb5-40e7-a85a-1e422b9f5ad7 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:00:46.596682 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-22b56589-cbb5-40e7-a85a-1e422b9f5ad7 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1258 microversion: 2.1 time: 0.173856 Jun 27 16:00:46.597257 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 563/1112] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:00:46 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:00:47.280882 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-2596bcc9-e8e2-4df4-bade-06fccb30b90f req-0fd761c1-41e6-43d2-9b28-31f298d420c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d68a32-ff52-4f19-accc-6c55798545ec", "name": "network-vif-plugged", "status": "completed", "tag": "ec6488b0-831b-486e-a2ba-6bed5cd24ff0"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 16:00:47.289159 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-2596bcc9-e8e2-4df4-bade-06fccb30b90f req-0fd761c1-41e6-43d2-9b28-31f298d420c8 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:47.289598 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-2596bcc9-e8e2-4df4-bade-06fccb30b90f req-0fd761c1-41e6-43d2-9b28-31f298d420c8 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:47.301564 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-2596bcc9-e8e2-4df4-bade-06fccb30b90f req-0fd761c1-41e6-43d2-9b28-31f298d420c8 service nova] Creating event network-vif-plugged:ec6488b0-831b-486e-a2ba-6bed5cd24ff0 for instance 20d68a32-ff52-4f19-accc-6c55798545ec on hv-cinder-84780 Jun 27 16:00:47.306558 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-2596bcc9-e8e2-4df4-bade-06fccb30b90f req-0fd761c1-41e6-43d2-9b28-31f298d420c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095888 Jun 27 16:00:47.307147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 550/1113] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 16:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 16:00:47.614567 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-c927eea4-83a8-4f05-9c06-b4751bd4c775 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:00:47.615243 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-c927eea4-83a8-4f05-9c06-b4751bd4c775 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:00:47.622850 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c927eea4-83a8-4f05-9c06-b4751bd4c775 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:47.623368 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c927eea4-83a8-4f05-9c06-b4751bd4c775 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:47.625051 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c927eea4-83a8-4f05-9c06-b4751bd4c775 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:47.625680 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-c927eea4-83a8-4f05-9c06-b4751bd4c775 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:47.774974 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-c927eea4-83a8-4f05-9c06-b4751bd4c775 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:00:47.786471 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-c927eea4-83a8-4f05-9c06-b4751bd4c775 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1258 microversion: 2.1 time: 0.175442 Jun 27 16:00:47.787223 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 564/1114] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:00:47 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:00:48.806928 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ecea5029-60cb-4cb9-adee-e8d1bba3f83a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:00:48.807682 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-ecea5029-60cb-4cb9-adee-e8d1bba3f83a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:00:48.821419 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ecea5029-60cb-4cb9-adee-e8d1bba3f83a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:48.821913 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ecea5029-60cb-4cb9-adee-e8d1bba3f83a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:48.822743 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ecea5029-60cb-4cb9-adee-e8d1bba3f83a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:48.823156 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ecea5029-60cb-4cb9-adee-e8d1bba3f83a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:48.971918 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ecea5029-60cb-4cb9-adee-e8d1bba3f83a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:00:48.980442 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ecea5029-60cb-4cb9-adee-e8d1bba3f83a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1442 microversion: 2.1 time: 0.178494 Jun 27 16:00:48.981020 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 551/1115] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:00:48 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1442 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:00:48.998249 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3b260454-3d00-40f2-af33-49bf9e529a0e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:00:48.998961 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3b260454-3d00-40f2-af33-49bf9e529a0e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:00:49.007522 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3b260454-3d00-40f2-af33-49bf9e529a0e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:49.008207 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3b260454-3d00-40f2-af33-49bf9e529a0e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:49.009238 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3b260454-3d00-40f2-af33-49bf9e529a0e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:49.009842 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3b260454-3d00-40f2-af33-49bf9e529a0e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:49.153453 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3b260454-3d00-40f2-af33-49bf9e529a0e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:00:49.161481 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3b260454-3d00-40f2-af33-49bf9e529a0e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1442 microversion: 2.1 time: 0.167065 Jun 27 16:00:49.162082 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 565/1116] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:00:48 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1442 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:00:51.196036 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-c3013588-7b71-49e8-ab93-522f9b5de718 req-7de8aa55-65cb-4148-ad92-ec3171696742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d68a32-ff52-4f19-accc-6c55798545ec", "tag": "ec6488b0-831b-486e-a2ba-6bed5cd24ff0"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 16:00:51.206063 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-c3013588-7b71-49e8-ab93-522f9b5de718 req-7de8aa55-65cb-4148-ad92-ec3171696742 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:00:51.206568 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-c3013588-7b71-49e8-ab93-522f9b5de718 req-7de8aa55-65cb-4148-ad92-ec3171696742 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:00:51.220794 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-c3013588-7b71-49e8-ab93-522f9b5de718 req-7de8aa55-65cb-4148-ad92-ec3171696742 service nova] Creating event network-changed:ec6488b0-831b-486e-a2ba-6bed5cd24ff0 for instance 20d68a32-ff52-4f19-accc-6c55798545ec on hv-cinder-84780 Jun 27 16:00:51.226448 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-c3013588-7b71-49e8-ab93-522f9b5de718 req-7de8aa55-65cb-4148-ad92-ec3171696742 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036313 Jun 27 16:00:51.227066 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 552/1117] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 16:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 16:01:26.856762 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 16:01:26.857558 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Mon Jun 27 16:01:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 16:01:59.585029 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 16:01:59.585693 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Mon Jun 27 16:01:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 16:02:46.533691 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=20 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:02:46.534450 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=48 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:02:46.539597 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-553acfeb-e5c9-41ab-95ec-87bfe50a4a8e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 16:02:46.540136 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-553acfeb-e5c9-41ab-95ec-87bfe50a4a8e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:02:46.547236 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-553acfeb-e5c9-41ab-95ec-87bfe50a4a8e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:46.547685 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-553acfeb-e5c9-41ab-95ec-87bfe50a4a8e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:46.548448 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-553acfeb-e5c9-41ab-95ec-87bfe50a4a8e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:46.548884 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-553acfeb-e5c9-41ab-95ec-87bfe50a4a8e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:46.572485 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.objects.instance [None req-553acfeb-e5c9-41ab-95ec-87bfe50a4a8e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lazy-loading 'flavor' on Instance uuid 20d68a32-ff52-4f19-accc-6c55798545ec {{(pid=129473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 16:02:46.645192 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-553acfeb-e5c9-41ab-95ec-87bfe50a4a8e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "POST /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec/action" status: 202 len: 0 microversion: 2.1 time: 0.113106 Jun 27 16:02:46.645801 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 566/1118] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 27 16:02:46 2022] POST /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 16:02:46.652642 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e9023ff2-98de-45e3-981a-a720b26776f5] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 27 16:02:46.653930 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:02:46.654862 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=44 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:02:46.659417 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-f96c4c4b-940e-420d-8add-c22cd09575a5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:02:46.660211 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-f96c4c4b-940e-420d-8add-c22cd09575a5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:02:46.669310 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f96c4c4b-940e-420d-8add-c22cd09575a5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:46.669807 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f96c4c4b-940e-420d-8add-c22cd09575a5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:46.670569 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f96c4c4b-940e-420d-8add-c22cd09575a5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:46.670998 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-f96c4c4b-940e-420d-8add-c22cd09575a5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:46.816781 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-f96c4c4b-940e-420d-8add-c22cd09575a5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:02:46.824647 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-f96c4c4b-940e-420d-8add-c22cd09575a5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1566 microversion: 2.1 time: 0.173798 Jun 27 16:02:46.825217 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 553/1119] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:02:46 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:02:47.842636 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-3489bd61-f329-4c34-8655-d1b2ea5b8d5a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:02:47.843332 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-3489bd61-f329-4c34-8655-d1b2ea5b8d5a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:02:47.850590 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3489bd61-f329-4c34-8655-d1b2ea5b8d5a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:47.851042 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3489bd61-f329-4c34-8655-d1b2ea5b8d5a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:47.851815 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3489bd61-f329-4c34-8655-d1b2ea5b8d5a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:47.852253 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-3489bd61-f329-4c34-8655-d1b2ea5b8d5a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:47.983744 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-3489bd61-f329-4c34-8655-d1b2ea5b8d5a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:02:47.991463 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-3489bd61-f329-4c34-8655-d1b2ea5b8d5a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1566 microversion: 2.1 time: 0.153148 Jun 27 16:02:47.992023 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 567/1120] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:02:47 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:02:49.008863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-cad38274-64ce-47d3-a7df-022504a51b79 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:02:49.009480 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-cad38274-64ce-47d3-a7df-022504a51b79 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:02:49.016759 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cad38274-64ce-47d3-a7df-022504a51b79 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:49.017212 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cad38274-64ce-47d3-a7df-022504a51b79 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:49.018014 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cad38274-64ce-47d3-a7df-022504a51b79 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:49.018456 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-cad38274-64ce-47d3-a7df-022504a51b79 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:49.024862 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO oslo.messaging._drivers.impl_rabbit [-] [e9023ff2-98de-45e3-981a-a720b26776f5] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51144. Jun 27 16:02:49.158689 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-cad38274-64ce-47d3-a7df-022504a51b79 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:02:49.167363 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-cad38274-64ce-47d3-a7df-022504a51b79 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1566 microversion: 2.1 time: 0.162463 Jun 27 16:02:49.167929 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 554/1121] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:02:49 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:02:50.184917 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ae2442b8-e92d-4f2d-9d12-e8039635f84a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:02:50.185564 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-ae2442b8-e92d-4f2d-9d12-e8039635f84a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:02:50.192095 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ae2442b8-e92d-4f2d-9d12-e8039635f84a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:50.192547 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ae2442b8-e92d-4f2d-9d12-e8039635f84a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:50.193942 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ae2442b8-e92d-4f2d-9d12-e8039635f84a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:50.194074 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-ae2442b8-e92d-4f2d-9d12-e8039635f84a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:50.328398 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-ae2442b8-e92d-4f2d-9d12-e8039635f84a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:02:50.336242 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-ae2442b8-e92d-4f2d-9d12-e8039635f84a tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1566 microversion: 2.1 time: 0.155222 Jun 27 16:02:50.336798 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 568/1122] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:02:50 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 16:02:51.353782 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-2a0f267a-ec13-44c1-ad04-f2d54edadc2c tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:02:51.354369 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-2a0f267a-ec13-44c1-ad04-f2d54edadc2c tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:02:51.360794 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2a0f267a-ec13-44c1-ad04-f2d54edadc2c tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:51.361230 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2a0f267a-ec13-44c1-ad04-f2d54edadc2c tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:51.362009 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2a0f267a-ec13-44c1-ad04-f2d54edadc2c tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:51.362438 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-2a0f267a-ec13-44c1-ad04-f2d54edadc2c tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:51.495487 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-2a0f267a-ec13-44c1-ad04-f2d54edadc2c tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:02:51.503133 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-2a0f267a-ec13-44c1-ad04-f2d54edadc2c tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1566 microversion: 2.1 time: 0.153420 Jun 27 16:02:51.503693 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 555/1123] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:02:51 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:02:52.520666 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-850d39fe-9fd1-4db5-b079-04b0fde7de40 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:02:52.522390 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-850d39fe-9fd1-4db5-b079-04b0fde7de40 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:02:52.528870 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-850d39fe-9fd1-4db5-b079-04b0fde7de40 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:52.529315 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-850d39fe-9fd1-4db5-b079-04b0fde7de40 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:52.530119 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-850d39fe-9fd1-4db5-b079-04b0fde7de40 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:52.530874 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-850d39fe-9fd1-4db5-b079-04b0fde7de40 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:52.923973 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-850d39fe-9fd1-4db5-b079-04b0fde7de40 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:02:52.931593 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-850d39fe-9fd1-4db5-b079-04b0fde7de40 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1566 microversion: 2.1 time: 0.414767 Jun 27 16:02:52.932161 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 569/1124] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:02:52 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1566 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:02:53.949432 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3992c51c-5d60-4843-bcc4-ad078b4be8b5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:02:53.950043 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3992c51c-5d60-4843-bcc4-ad078b4be8b5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:02:53.956793 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3992c51c-5d60-4843-bcc4-ad078b4be8b5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:53.957233 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3992c51c-5d60-4843-bcc4-ad078b4be8b5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:53.958029 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3992c51c-5d60-4843-bcc4-ad078b4be8b5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:53.958459 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3992c51c-5d60-4843-bcc4-ad078b4be8b5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:54.090555 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3992c51c-5d60-4843-bcc4-ad078b4be8b5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:02:54.098066 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3992c51c-5d60-4843-bcc4-ad078b4be8b5 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1566 microversion: 2.1 time: 0.152410 Jun 27 16:02:54.098627 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 556/1125] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:02:53 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:02:55.115077 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4abd7e00-cc61-4170-8366-1e181bb3b0c3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:02:55.115691 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-4abd7e00-cc61-4170-8366-1e181bb3b0c3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:02:55.122442 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4abd7e00-cc61-4170-8366-1e181bb3b0c3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:55.122894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4abd7e00-cc61-4170-8366-1e181bb3b0c3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:55.123673 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4abd7e00-cc61-4170-8366-1e181bb3b0c3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:55.124108 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4abd7e00-cc61-4170-8366-1e181bb3b0c3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:55.260613 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4abd7e00-cc61-4170-8366-1e181bb3b0c3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:02:55.268333 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4abd7e00-cc61-4170-8366-1e181bb3b0c3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1566 microversion: 2.1 time: 0.157267 Jun 27 16:02:55.268903 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 570/1126] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:02:55 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:02:56.286277 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-c7b16db3-a190-4d65-b964-d2b8d1822310 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:02:56.287662 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-c7b16db3-a190-4d65-b964-d2b8d1822310 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:02:56.294040 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c7b16db3-a190-4d65-b964-d2b8d1822310 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:56.294491 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c7b16db3-a190-4d65-b964-d2b8d1822310 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:56.295258 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c7b16db3-a190-4d65-b964-d2b8d1822310 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:56.295694 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-c7b16db3-a190-4d65-b964-d2b8d1822310 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:56.429763 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-c7b16db3-a190-4d65-b964-d2b8d1822310 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:02:56.437223 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-c7b16db3-a190-4d65-b964-d2b8d1822310 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1566 microversion: 2.1 time: 0.154806 Jun 27 16:02:56.437805 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 557/1127] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:02:56 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 16:02:57.454409 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-e2c7dda1-5959-4929-b298-3eb728b5812f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:02:57.455022 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-e2c7dda1-5959-4929-b298-3eb728b5812f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:02:57.461707 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e2c7dda1-5959-4929-b298-3eb728b5812f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:57.462160 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e2c7dda1-5959-4929-b298-3eb728b5812f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:57.462934 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e2c7dda1-5959-4929-b298-3eb728b5812f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:57.463365 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-e2c7dda1-5959-4929-b298-3eb728b5812f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:57.597938 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-e2c7dda1-5959-4929-b298-3eb728b5812f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:02:57.605892 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-e2c7dda1-5959-4929-b298-3eb728b5812f tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1566 microversion: 2.1 time: 0.155374 Jun 27 16:02:57.606496 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 571/1128] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:02:57 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:02:58.623641 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-e8f57bf1-cf33-4ab5-b2b9-89d133105819 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:02:58.624245 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-e8f57bf1-cf33-4ab5-b2b9-89d133105819 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:02:58.631637 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e8f57bf1-cf33-4ab5-b2b9-89d133105819 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:58.632093 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e8f57bf1-cf33-4ab5-b2b9-89d133105819 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:58.632862 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e8f57bf1-cf33-4ab5-b2b9-89d133105819 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:58.633305 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-e8f57bf1-cf33-4ab5-b2b9-89d133105819 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:58.764211 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-e8f57bf1-cf33-4ab5-b2b9-89d133105819 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:02:58.772233 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-e8f57bf1-cf33-4ab5-b2b9-89d133105819 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1566 microversion: 2.1 time: 0.152475 Jun 27 16:02:58.772787 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 558/1129] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:02:58 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:02:59.719387 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 16:02:59.719963 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Mon Jun 27 16:02:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 16:02:59.789525 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-36997b7a-4175-4bd1-9e4f-3c92f0f9a3f2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:02:59.790166 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-36997b7a-4175-4bd1-9e4f-3c92f0f9a3f2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:02:59.798095 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-36997b7a-4175-4bd1-9e4f-3c92f0f9a3f2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:59.798639 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-36997b7a-4175-4bd1-9e4f-3c92f0f9a3f2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:59.799521 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-36997b7a-4175-4bd1-9e4f-3c92f0f9a3f2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:59.800028 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-36997b7a-4175-4bd1-9e4f-3c92f0f9a3f2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:59.933495 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-36997b7a-4175-4bd1-9e4f-3c92f0f9a3f2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:02:59.941038 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-36997b7a-4175-4bd1-9e4f-3c92f0f9a3f2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1507 microversion: 2.1 time: 0.155928 Jun 27 16:02:59.941592 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 572/1130] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:02:59 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:02:59.957976 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-bd58c5e9-c30d-4463-898e-ba793b83e9e9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 16:02:59.959965 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-bd58c5e9-c30d-4463-898e-ba793b83e9e9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:02:59.966029 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bd58c5e9-c30d-4463-898e-ba793b83e9e9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:59.966478 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bd58c5e9-c30d-4463-898e-ba793b83e9e9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:02:59.967235 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bd58c5e9-c30d-4463-898e-ba793b83e9e9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:02:59.967700 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-bd58c5e9-c30d-4463-898e-ba793b83e9e9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:00.057152 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-bd58c5e9-c30d-4463-898e-ba793b83e9e9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "POST /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec/action" status: 202 len: 0 microversion: 2.1 time: 0.103037 Jun 27 16:03:00.059024 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 559/1131] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jun 27 16:02:59 2022] POST /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 16:03:00.065754 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-039a92e1-5aa3-4f76-98fa-1ae238496538 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:03:00.066363 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-039a92e1-5aa3-4f76-98fa-1ae238496538 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:03:00.073003 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-039a92e1-5aa3-4f76-98fa-1ae238496538 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:00.073448 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-039a92e1-5aa3-4f76-98fa-1ae238496538 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:00.074244 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-039a92e1-5aa3-4f76-98fa-1ae238496538 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:00.074688 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-039a92e1-5aa3-4f76-98fa-1ae238496538 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:00.291496 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-039a92e1-5aa3-4f76-98fa-1ae238496538 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:03:00.299377 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-039a92e1-5aa3-4f76-98fa-1ae238496538 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1515 microversion: 2.1 time: 0.237451 Jun 27 16:03:00.299935 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 573/1132] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:03:00 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1515 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:03:01.317966 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-28027b03-5044-4a86-8004-eca525dee3fa tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:03:01.318577 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-28027b03-5044-4a86-8004-eca525dee3fa tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:03:01.325614 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-28027b03-5044-4a86-8004-eca525dee3fa tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:01.326054 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-28027b03-5044-4a86-8004-eca525dee3fa tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:01.326863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-28027b03-5044-4a86-8004-eca525dee3fa tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:01.327299 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-28027b03-5044-4a86-8004-eca525dee3fa tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:01.513281 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-28027b03-5044-4a86-8004-eca525dee3fa tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:03:01.520649 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-28027b03-5044-4a86-8004-eca525dee3fa tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1515 microversion: 2.1 time: 0.207133 Jun 27 16:03:01.521821 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 560/1133] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:03:01 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1515 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:03:01.932379 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 16:03:01.932945 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Mon Jun 27 16:03:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 16:03:02.540582 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-9828ab36-b020-4396-aeb5-9c54e3ab8a9d tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:03:02.541191 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-9828ab36-b020-4396-aeb5-9c54e3ab8a9d tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:03:02.547938 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9828ab36-b020-4396-aeb5-9c54e3ab8a9d tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:02.548378 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9828ab36-b020-4396-aeb5-9c54e3ab8a9d tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:02.549127 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9828ab36-b020-4396-aeb5-9c54e3ab8a9d tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:02.549554 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-9828ab36-b020-4396-aeb5-9c54e3ab8a9d tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:02.681049 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-9828ab36-b020-4396-aeb5-9c54e3ab8a9d tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:03:02.688629 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-9828ab36-b020-4396-aeb5-9c54e3ab8a9d tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1515 microversion: 2.1 time: 0.152505 Jun 27 16:03:02.689202 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 574/1134] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:03:02 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:03:03.706614 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-ec20ac26-459d-41fd-a2b6-f3d88ca72ba2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:03:03.707219 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-ec20ac26-459d-41fd-a2b6-f3d88ca72ba2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:03:03.714250 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ec20ac26-459d-41fd-a2b6-f3d88ca72ba2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:03.714698 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ec20ac26-459d-41fd-a2b6-f3d88ca72ba2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:03.715469 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ec20ac26-459d-41fd-a2b6-f3d88ca72ba2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:03.715897 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-ec20ac26-459d-41fd-a2b6-f3d88ca72ba2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:03.799448 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-8afcb270-862e-4d0c-a14e-2746f9ac5450 req-8d2f571c-e842-4620-8ee5-5581c7d11959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d68a32-ff52-4f19-accc-6c55798545ec", "name": "network-vif-unplugged", "status": "completed", "tag": "ec6488b0-831b-486e-a2ba-6bed5cd24ff0"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 16:03:03.812237 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-8afcb270-862e-4d0c-a14e-2746f9ac5450 req-8d2f571c-e842-4620-8ee5-5581c7d11959 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:03.812716 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-8afcb270-862e-4d0c-a14e-2746f9ac5450 req-8d2f571c-e842-4620-8ee5-5581c7d11959 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:03.828060 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.compute.server_external_events [req-8afcb270-862e-4d0c-a14e-2746f9ac5450 req-8d2f571c-e842-4620-8ee5-5581c7d11959 service nova] Unable to find a host for instance 20d68a32-ff52-4f19-accc-6c55798545ec. Dropping event network-vif-unplugged {{(pid=129473) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 27 16:03:03.828441 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-8afcb270-862e-4d0c-a14e-2746f9ac5450 req-8d2f571c-e842-4620-8ee5-5581c7d11959 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033434 Jun 27 16:03:03.829542 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 575/1135] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 16:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 27 16:03:03.862939 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-ec20ac26-459d-41fd-a2b6-f3d88ca72ba2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:03:03.872089 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-ec20ac26-459d-41fd-a2b6-f3d88ca72ba2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1515 microversion: 2.1 time: 0.169286 Jun 27 16:03:03.872635 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 561/1136] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:03:03 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 16:03:04.889172 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-4fca484b-14d9-4cf5-bcb6-f0b41565ad19 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:03:04.889831 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-4fca484b-14d9-4cf5-bcb6-f0b41565ad19 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:03:04.896460 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4fca484b-14d9-4cf5-bcb6-f0b41565ad19 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:04.896912 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4fca484b-14d9-4cf5-bcb6-f0b41565ad19 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:04.897711 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4fca484b-14d9-4cf5-bcb6-f0b41565ad19 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:04.898155 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-4fca484b-14d9-4cf5-bcb6-f0b41565ad19 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:05.035149 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-4fca484b-14d9-4cf5-bcb6-f0b41565ad19 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:03:05.043182 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-4fca484b-14d9-4cf5-bcb6-f0b41565ad19 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1517 microversion: 2.1 time: 0.157837 Jun 27 16:03:05.043748 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 576/1137] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:03:04 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:03:06.060242 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3a813fa1-4533-45c6-abf4-4332ed3fbaea tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:03:06.060834 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3a813fa1-4533-45c6-abf4-4332ed3fbaea tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:03:06.067296 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3a813fa1-4533-45c6-abf4-4332ed3fbaea tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:06.067769 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3a813fa1-4533-45c6-abf4-4332ed3fbaea tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:06.068575 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3a813fa1-4533-45c6-abf4-4332ed3fbaea tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:06.069004 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3a813fa1-4533-45c6-abf4-4332ed3fbaea tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:06.211402 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3a813fa1-4533-45c6-abf4-4332ed3fbaea tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:03:06.218970 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3a813fa1-4533-45c6-abf4-4332ed3fbaea tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1573 microversion: 2.1 time: 0.162590 Jun 27 16:03:06.219532 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 562/1138] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:03:06 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:03:07.236273 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-1a4cf384-2f5b-4cb1-b6a2-9d83bdce38b2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:03:07.236884 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-1a4cf384-2f5b-4cb1-b6a2-9d83bdce38b2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:03:07.244527 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1a4cf384-2f5b-4cb1-b6a2-9d83bdce38b2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:07.244970 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1a4cf384-2f5b-4cb1-b6a2-9d83bdce38b2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:07.245770 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1a4cf384-2f5b-4cb1-b6a2-9d83bdce38b2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:07.246209 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1a4cf384-2f5b-4cb1-b6a2-9d83bdce38b2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:07.376729 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-1a4cf384-2f5b-4cb1-b6a2-9d83bdce38b2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:03:07.385194 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-1a4cf384-2f5b-4cb1-b6a2-9d83bdce38b2 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1573 microversion: 2.1 time: 0.152796 Jun 27 16:03:07.385770 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 577/1139] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:03:07 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:03:08.402037 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-6818777b-dcbf-47f2-a9ee-ec49cf7b83b8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:03:08.402656 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-6818777b-dcbf-47f2-a9ee-ec49cf7b83b8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:03:08.409283 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6818777b-dcbf-47f2-a9ee-ec49cf7b83b8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:08.409784 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6818777b-dcbf-47f2-a9ee-ec49cf7b83b8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:08.410544 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6818777b-dcbf-47f2-a9ee-ec49cf7b83b8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:08.410983 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-6818777b-dcbf-47f2-a9ee-ec49cf7b83b8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:08.551639 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-6818777b-dcbf-47f2-a9ee-ec49cf7b83b8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:03:08.559867 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-6818777b-dcbf-47f2-a9ee-ec49cf7b83b8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1573 microversion: 2.1 time: 0.161792 Jun 27 16:03:08.560430 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 563/1140] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:03:08 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:03:09.578643 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-dfcaeb60-d72f-4445-88de-0a69371ed4e8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:03:09.579261 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-dfcaeb60-d72f-4445-88de-0a69371ed4e8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:03:09.586505 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dfcaeb60-d72f-4445-88de-0a69371ed4e8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:09.587070 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dfcaeb60-d72f-4445-88de-0a69371ed4e8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:09.587836 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dfcaeb60-d72f-4445-88de-0a69371ed4e8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:09.588267 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-dfcaeb60-d72f-4445-88de-0a69371ed4e8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:09.723602 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-dfcaeb60-d72f-4445-88de-0a69371ed4e8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:03:09.731105 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-dfcaeb60-d72f-4445-88de-0a69371ed4e8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1573 microversion: 2.1 time: 0.157602 Jun 27 16:03:09.731660 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 578/1141] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:03:09 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:03:10.748707 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-d9168344-e75c-465f-9f20-3ab6af52e7d1 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:03:10.749295 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-d9168344-e75c-465f-9f20-3ab6af52e7d1 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:03:10.755859 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d9168344-e75c-465f-9f20-3ab6af52e7d1 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:10.756301 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d9168344-e75c-465f-9f20-3ab6af52e7d1 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:10.757078 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d9168344-e75c-465f-9f20-3ab6af52e7d1 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:10.757507 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-d9168344-e75c-465f-9f20-3ab6af52e7d1 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:10.894477 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-d9168344-e75c-465f-9f20-3ab6af52e7d1 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:03:10.903042 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-d9168344-e75c-465f-9f20-3ab6af52e7d1 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1573 microversion: 2.1 time: 0.158356 Jun 27 16:03:10.903615 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 564/1142] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:03:10 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 16:03:11.919544 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-d531c88c-4545-43c1-83ea-2a8b36f453c9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:03:11.920156 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-d531c88c-4545-43c1-83ea-2a8b36f453c9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:03:11.927000 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d531c88c-4545-43c1-83ea-2a8b36f453c9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:11.927457 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d531c88c-4545-43c1-83ea-2a8b36f453c9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:11.928224 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d531c88c-4545-43c1-83ea-2a8b36f453c9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:11.928663 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-d531c88c-4545-43c1-83ea-2a8b36f453c9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:12.064084 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-d531c88c-4545-43c1-83ea-2a8b36f453c9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:03:12.072586 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-d531c88c-4545-43c1-83ea-2a8b36f453c9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1573 microversion: 2.1 time: 0.156776 Jun 27 16:03:12.073158 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 579/1143] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:03:11 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:03:13.090580 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-630d3b95-a462-4d0c-88eb-7d957b021f13 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:03:13.091217 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-630d3b95-a462-4d0c-88eb-7d957b021f13 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:03:13.097872 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-630d3b95-a462-4d0c-88eb-7d957b021f13 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:13.098335 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-630d3b95-a462-4d0c-88eb-7d957b021f13 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:13.099092 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-630d3b95-a462-4d0c-88eb-7d957b021f13 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:13.099530 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-630d3b95-a462-4d0c-88eb-7d957b021f13 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:13.248413 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-630d3b95-a462-4d0c-88eb-7d957b021f13 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:03:13.262584 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-630d3b95-a462-4d0c-88eb-7d957b021f13 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1573 microversion: 2.1 time: 0.176244 Jun 27 16:03:13.263664 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 565/1144] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:03:13 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1573 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:03:14.288445 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-de15bbca-7ae9-41cc-a7b2-388290668631 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:03:14.289048 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-de15bbca-7ae9-41cc-a7b2-388290668631 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:03:14.295711 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-de15bbca-7ae9-41cc-a7b2-388290668631 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:14.296166 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-de15bbca-7ae9-41cc-a7b2-388290668631 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:14.297193 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-de15bbca-7ae9-41cc-a7b2-388290668631 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:14.297670 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-de15bbca-7ae9-41cc-a7b2-388290668631 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:14.437734 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-de15bbca-7ae9-41cc-a7b2-388290668631 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:03:14.445423 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-de15bbca-7ae9-41cc-a7b2-388290668631 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1573 microversion: 2.1 time: 0.160783 Jun 27 16:03:14.446101 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 580/1145] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:03:14 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:03:15.464397 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-5e542c93-00b0-423f-aad2-a685806b7b2e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:03:15.464955 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-5e542c93-00b0-423f-aad2-a685806b7b2e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:03:15.471583 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5e542c93-00b0-423f-aad2-a685806b7b2e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:15.472035 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5e542c93-00b0-423f-aad2-a685806b7b2e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:15.472809 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5e542c93-00b0-423f-aad2-a685806b7b2e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:15.473537 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-5e542c93-00b0-423f-aad2-a685806b7b2e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:15.612502 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-5e542c93-00b0-423f-aad2-a685806b7b2e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:03:15.621315 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-5e542c93-00b0-423f-aad2-a685806b7b2e tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1573 microversion: 2.1 time: 0.161341 Jun 27 16:03:15.621949 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 566/1146] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:03:15 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:03:16.639290 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-bebccb1b-2284-4c99-b3f0-374da6d99cc3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:03:16.639894 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-bebccb1b-2284-4c99-b3f0-374da6d99cc3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:03:16.642146 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=31 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:03:16.647663 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bebccb1b-2284-4c99-b3f0-374da6d99cc3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:16.648114 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bebccb1b-2284-4c99-b3f0-374da6d99cc3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:16.648888 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bebccb1b-2284-4c99-b3f0-374da6d99cc3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:16.650140 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-bebccb1b-2284-4c99-b3f0-374da6d99cc3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:16.652984 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:03:16.793560 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-bebccb1b-2284-4c99-b3f0-374da6d99cc3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:03:16.801752 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-bebccb1b-2284-4c99-b3f0-374da6d99cc3 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1573 microversion: 2.1 time: 0.166295 Jun 27 16:03:16.802286 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 581/1147] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:03:16 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:03:17.819035 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-3789eb95-01b1-4ca0-b9e2-f83d7e8fcf9c tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:03:17.819897 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-3789eb95-01b1-4ca0-b9e2-f83d7e8fcf9c tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:03:17.823282 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=31 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:03:17.829508 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3789eb95-01b1-4ca0-b9e2-f83d7e8fcf9c tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:17.830003 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3789eb95-01b1-4ca0-b9e2-f83d7e8fcf9c tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:17.830784 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3789eb95-01b1-4ca0-b9e2-f83d7e8fcf9c tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:17.831226 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-3789eb95-01b1-4ca0-b9e2-f83d7e8fcf9c tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:17.834090 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:03:17.940570 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [req-4fe7c121-8ae6-4bf6-ad38-ebb2d421a6f8 req-d8291edf-c24e-403a-ae09-5ea5629dc1fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d68a32-ff52-4f19-accc-6c55798545ec", "name": "network-vif-plugged", "status": "completed", "tag": "ec6488b0-831b-486e-a2ba-6bed5cd24ff0"}]} {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 16:03:17.952431 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-4fe7c121-8ae6-4bf6-ad38-ebb2d421a6f8 req-d8291edf-c24e-403a-ae09-5ea5629dc1fc service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:17.952906 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [req-4fe7c121-8ae6-4bf6-ad38-ebb2d421a6f8 req-d8291edf-c24e-403a-ae09-5ea5629dc1fc service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:17.966643 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.compute.server_external_events [req-4fe7c121-8ae6-4bf6-ad38-ebb2d421a6f8 req-d8291edf-c24e-403a-ae09-5ea5629dc1fc service nova] Creating event network-vif-plugged:ec6488b0-831b-486e-a2ba-6bed5cd24ff0 for instance 20d68a32-ff52-4f19-accc-6c55798545ec on hv-cinder-84780 Jun 27 16:03:17.972159 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [req-4fe7c121-8ae6-4bf6-ad38-ebb2d421a6f8 req-d8291edf-c24e-403a-ae09-5ea5629dc1fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035488 Jun 27 16:03:17.973817 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 582/1148] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 16:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 16:03:17.983905 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-3789eb95-01b1-4ca0-b9e2-f83d7e8fcf9c tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:03:17.992341 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-3789eb95-01b1-4ca0-b9e2-f83d7e8fcf9c tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1573 microversion: 2.1 time: 0.177281 Jun 27 16:03:17.993048 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 567/1149] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:03:17 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1573 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:03:19.012369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-66831978-2957-4d83-a633-4db7e9837699 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:03:19.013066 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-66831978-2957-4d83-a633-4db7e9837699 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:03:19.019535 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-66831978-2957-4d83-a633-4db7e9837699 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:19.019987 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-66831978-2957-4d83-a633-4db7e9837699 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:19.020789 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-66831978-2957-4d83-a633-4db7e9837699 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:19.021234 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-66831978-2957-4d83-a633-4db7e9837699 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:19.172654 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-66831978-2957-4d83-a633-4db7e9837699 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:03:19.180369 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-66831978-2957-4d83-a633-4db7e9837699 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1573 microversion: 2.1 time: 0.173520 Jun 27 16:03:19.181349 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 583/1150] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:03:19 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:03:20.199164 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-60fdca30-f632-42a4-a0ce-74651fafc46d tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:03:20.199918 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-60fdca30-f632-42a4-a0ce-74651fafc46d tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:03:20.206340 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-60fdca30-f632-42a4-a0ce-74651fafc46d tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:20.206837 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-60fdca30-f632-42a4-a0ce-74651fafc46d tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:20.207673 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-60fdca30-f632-42a4-a0ce-74651fafc46d tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:03:20.208157 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-60fdca30-f632-42a4-a0ce-74651fafc46d tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:03:20.380671 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-60fdca30-f632-42a4-a0ce-74651fafc46d tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:03:20.388850 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-60fdca30-f632-42a4-a0ce-74651fafc46d tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1560 microversion: 2.1 time: 0.194607 Jun 27 16:03:20.389445 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 568/1151] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:03:20 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1560 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:03:20.563007 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 16:03:20.563236 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Mon Jun 27 16:03:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 16:04:33.597825 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_api:SELECT=5 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:04:33.599045 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG dbcounter [-] [129473] Writing DB stats nova_cell1:SELECT=13 {{(pid=129473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:04:33.600433 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_api:SELECT=3 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:04:33.601337 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG dbcounter [-] [129472] Writing DB stats nova_cell1:SELECT=11 {{(pid=129472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 16:04:33.603860 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-48bae396-5146-49e6-9efa-f2c110471bde tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:04:33.604496 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-48bae396-5146-49e6-9efa-f2c110471bde tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:04:33.614245 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-48bae396-5146-49e6-9efa-f2c110471bde tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:04:33.615763 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-48bae396-5146-49e6-9efa-f2c110471bde tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:04:33.616574 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-48bae396-5146-49e6-9efa-f2c110471bde tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:04:33.617371 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-48bae396-5146-49e6-9efa-f2c110471bde tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:04:33.644270 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-48bae396-5146-49e6-9efa-f2c110471bde tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Going to try to terminate instance {{(pid=129473) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 16:04:33.666222 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-384c6ea0-84d7-43dc-9a39-2fa7f3aabb73 req-06c93750-25c5-4c70-b2ea-8a2fc8dfaea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d68a32-ff52-4f19-accc-6c55798545ec", "tag": "ec6488b0-831b-486e-a2ba-6bed5cd24ff0"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 16:04:33.675176 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-384c6ea0-84d7-43dc-9a39-2fa7f3aabb73 req-06c93750-25c5-4c70-b2ea-8a2fc8dfaea6 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:04:33.675705 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-384c6ea0-84d7-43dc-9a39-2fa7f3aabb73 req-06c93750-25c5-4c70-b2ea-8a2fc8dfaea6 service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:04:33.689430 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-384c6ea0-84d7-43dc-9a39-2fa7f3aabb73 req-06c93750-25c5-4c70-b2ea-8a2fc8dfaea6 service nova] Creating event network-changed:ec6488b0-831b-486e-a2ba-6bed5cd24ff0 for instance 20d68a32-ff52-4f19-accc-6c55798545ec on hv-cinder-84780 Jun 27 16:04:33.697687 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-384c6ea0-84d7-43dc-9a39-2fa7f3aabb73 req-06c93750-25c5-4c70-b2ea-8a2fc8dfaea6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099090 Jun 27 16:04:33.698630 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 569/1152] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 16:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 16:04:33.738150 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-48bae396-5146-49e6-9efa-f2c110471bde tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 204 len: 0 microversion: 2.1 time: 0.141838 Jun 27 16:04:33.739002 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 584/1153] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jun 27 16:04:33 2022] DELETE /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 16:04:33.747949 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-1ebcc32f-6412-4677-8dfd-4a856d9ee7d9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:04:33.748643 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-1ebcc32f-6412-4677-8dfd-4a856d9ee7d9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:04:33.755415 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1ebcc32f-6412-4677-8dfd-4a856d9ee7d9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:04:33.755880 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1ebcc32f-6412-4677-8dfd-4a856d9ee7d9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:04:33.756811 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1ebcc32f-6412-4677-8dfd-4a856d9ee7d9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:04:33.757261 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-1ebcc32f-6412-4677-8dfd-4a856d9ee7d9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:04:33.902210 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.policy [None req-1ebcc32f-6412-4677-8dfd-4a856d9ee7d9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:04:33.909805 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-1ebcc32f-6412-4677-8dfd-4a856d9ee7d9 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1566 microversion: 2.1 time: 0.166030 Jun 27 16:04:33.910367 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 570/1154] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:04:33 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:04:34.930000 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-1049840c-c87c-40f1-a393-ff73bc329d2b tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:04:34.930770 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-1049840c-c87c-40f1-a393-ff73bc329d2b tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:04:34.937723 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1049840c-c87c-40f1-a393-ff73bc329d2b tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:04:34.938168 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1049840c-c87c-40f1-a393-ff73bc329d2b tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:04:34.938925 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1049840c-c87c-40f1-a393-ff73bc329d2b tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:04:34.939351 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-1049840c-c87c-40f1-a393-ff73bc329d2b tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:04:35.076199 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-1049840c-c87c-40f1-a393-ff73bc329d2b tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:04:35.083821 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-1049840c-c87c-40f1-a393-ff73bc329d2b tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1566 microversion: 2.1 time: 0.158783 Jun 27 16:04:35.084388 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 585/1155] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:04:34 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:04:35.944788 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [req-ec280ecb-af16-459c-8968-575935c56004 req-a6ada974-fcc6-4624-befa-4960a477b25f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d68a32-ff52-4f19-accc-6c55798545ec", "name": "network-vif-deleted", "tag": "ec6488b0-831b-486e-a2ba-6bed5cd24ff0"}]} {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 16:04:35.953846 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-ec280ecb-af16-459c-8968-575935c56004 req-a6ada974-fcc6-4624-befa-4960a477b25f service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:04:35.954283 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [req-ec280ecb-af16-459c-8968-575935c56004 req-a6ada974-fcc6-4624-befa-4960a477b25f service nova] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:04:35.966862 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.compute.server_external_events [req-ec280ecb-af16-459c-8968-575935c56004 req-a6ada974-fcc6-4624-befa-4960a477b25f service nova] Creating event network-vif-deleted:ec6488b0-831b-486e-a2ba-6bed5cd24ff0 for instance 20d68a32-ff52-4f19-accc-6c55798545ec on hv-cinder-84780 Jun 27 16:04:35.972929 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [req-ec280ecb-af16-459c-8968-575935c56004 req-a6ada974-fcc6-4624-befa-4960a477b25f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031865 Jun 27 16:04:35.973535 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 571/1156] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jun 27 16:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 16:04:36.103008 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-fa18353c-5166-40d4-b46f-8602da5d9882 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:04:36.103603 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.compute.api [None req-fa18353c-5166-40d4-b46f-8602da5d9882 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129473) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:04:36.110082 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fa18353c-5166-40d4-b46f-8602da5d9882 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:04:36.110523 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fa18353c-5166-40d4-b46f-8602da5d9882 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:04:36.111277 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fa18353c-5166-40d4-b46f-8602da5d9882 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:04:36.111703 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG oslo_concurrency.lockutils [None req-fa18353c-5166-40d4-b46f-8602da5d9882 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:04:36.176174 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.policy [None req-fa18353c-5166-40d4-b46f-8602da5d9882 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffd1a8597e94f69b1bd98bd6ea7b294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636c72ef28514ac5aef5779a137d9df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129473) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 16:04:36.184972 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-fa18353c-5166-40d4-b46f-8602da5d9882 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 200 len: 1218 microversion: 2.1 time: 0.086403 Jun 27 16:04:36.185545 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 586/1157] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:04:36 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 16:04:37.202917 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9a10063f-b138-49a3-92e0-48549c7118d8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '>' {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:04:37.203624 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.compute.api [None req-9a10063f-b138-49a3-92e0-48549c7118d8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] [instance: 20d68a32-ff52-4f19-accc-6c55798545ec] Fetching instance by UUID {{(pid=129472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 16:04:37.210418 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9a10063f-b138-49a3-92e0-48549c7118d8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:04:37.211247 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9a10063f-b138-49a3-92e0-48549c7118d8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:04:37.212313 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9a10063f-b138-49a3-92e0-48549c7118d8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 16:04:37.212763 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG oslo_concurrency.lockutils [None req-9a10063f-b138-49a3-92e0-48549c7118d8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Lock "36cad6b8-e240-4e63-a1f3-ff7ac63edcb9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 16:04:37.226065 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.wsgi [None req-9a10063f-b138-49a3-92e0-48549c7118d8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] HTTP exception thrown: Instance 20d68a32-ff52-4f19-accc-6c55798545ec could not be found. Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9a10063f-b138-49a3-92e0-48549c7118d8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Request method failure captured: Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: request: GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec HTTP/1.1 Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept: application/json Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Accept-Encoding: identity Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Connection: close Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Length: 0 Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Content-Type: application/json Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Host: 10.222.0.20 Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Openstack-System-Scope: None Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: User-Agent: python-urllib3/1.26.9 Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Auth-Token: gAAAAABiudQKM1xZPNurYI0cq9PdXDwoK6Okifi0MEmuV2HL9N4f5jv72Ai64G5zyHFQcQ0SJUgy_dW5WDIESvccKw6Z9nZMGkOchFlgzPHm-fABuTUhDpJiVZcJ2nyYLV74cUxhIU68eSuMycbCqbHw3WM2mAARa6Af6cHiXKKKgjf1e2vaZIY Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Id: None Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Domain-Name: None Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Identity-Status: Confirmed Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Is-Admin-Project: True Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Id: default Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Domain-Name: Default Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Id: 636c72ef28514ac5aef5779a137d9df7 Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Project-Name: tempest-TestShelveInstance-1213020120 Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Role: reader,member Jun 27 16:04:37.227956 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Roles: reader,member Jun 27 16:04:37.229806 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/636c72ef28514ac5aef5779a137d9df7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/636c72ef28514ac5aef5779a137d9df7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/636c72ef28514ac5aef5779a137d9df7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_636c72ef28514ac5aef5779a137d9df7", "adminURL": "http://10.222.0.20:8080"}]}] Jun 27 16:04:37.229806 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant: tempest-TestShelveInstance-1213020120 Jun 27 16:04:37.229806 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Id: 636c72ef28514ac5aef5779a137d9df7 Jun 27 16:04:37.229806 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-Tenant-Name: tempest-TestShelveInstance-1213020120 Jun 27 16:04:37.229806 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User: tempest-TestShelveInstance-1213020120-project Jun 27 16:04:37.229806 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Id: default Jun 27 16:04:37.229806 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Domain-Name: Default Jun 27 16:04:37.229806 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Id: bffd1a8597e94f69b1bd98bd6ea7b294 Jun 27 16:04:37.229806 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: X-User-Name: tempest-TestShelveInstance-1213020120-project Jun 27 16:04:37.229806 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: method: > Jun 27 16:04:37.229806 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: exception: Instance 20d68a32-ff52-4f19-accc-6c55798545ec could not be found. Jun 27 16:04:37.229806 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: action_args: {'id': '20d68a32-ff52-4f19-accc-6c55798545ec'} Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: {{(pid=129472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d68a32-ff52-4f19-accc-6c55798545ec could not be found. Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 16:04:37.231147 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 16:04:37.232863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 16:04:37.232863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 16:04:37.232863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 16:04:37.232863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 16:04:37.232863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 16:04:37.232863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 16:04:37.232863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 16:04:37.232863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d68a32-ff52-4f19-accc-6c55798545ec could not be found. Jun 27 16:04:37.232863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 16:04:37.232863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 16:04:37.232863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 16:04:37.232863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 16:04:37.232863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 16:04:37.232863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 16:04:37.232863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 16:04:37.232863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 16:04:37.232863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d68a32-ff52-4f19-accc-6c55798545ec could not be found. Jun 27 16:04:37.232863 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: ERROR nova.api.openstack.wsgi Jun 27 16:04:37.234467 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: DEBUG nova.api.openstack.wsgi [None req-9a10063f-b138-49a3-92e0-48549c7118d8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Returning 404 to user: Instance 20d68a32-ff52-4f19-accc-6c55798545ec could not be found. {{(pid=129472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 16:04:37.234467 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO nova.api.openstack.requestlog [None req-9a10063f-b138-49a3-92e0-48549c7118d8 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec" status: 404 len: 111 microversion: 2.1 time: 0.030725 Jun 27 16:04:37.234467 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: [pid: 129472|app: 0|req: 572/1158] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jun 27 16:04:37 2022] GET /compute/v2.1/servers/20d68a32-ff52-4f19-accc-6c55798545ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 16:04:37.394640 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: DEBUG nova.api.openstack.wsgi [None req-ee01f330-4181-4ba4-bdde-86cf11faa2c6 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] Calling method '.version_select at 0x7fe14ac52d30>' {{(pid=129473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 16:04:37.419045 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO nova.api.openstack.requestlog [None req-ee01f330-4181-4ba4-bdde-86cf11faa2c6 tempest-TestShelveInstance-1213020120 tempest-TestShelveInstance-1213020120-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-167746861" status: 202 len: 0 microversion: 2.1 time: 0.029651 Jun 27 16:04:37.419683 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: [pid: 129473|app: 0|req: 587/1159] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jun 27 16:04:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-167746861 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 16:04:46.868432 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 16:04:46.869052 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Mon Jun 27 16:04:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 16:06:21.940355 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 16:06:21.940985 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Mon Jun 27 16:06:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 16:06:59.595316 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 16:06:59.596058 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Mon Jun 27 16:06:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 16:08:06.876765 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 16:08:06.877417 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Mon Jun 27 16:08:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 16:08:16.372969 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 16:08:16.373752 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Mon Jun 27 16:08:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 16:09:39.732670 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 16:09:39.733295 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Mon Jun 27 16:09:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 16:09:41.949525 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 16:09:41.950302 dv-cinder-847801-1-iscsi devstack@n-api.service[129473]: Mon Jun 27 16:09:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 16:10:00.574855 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 16:10:00.575596 dv-cinder-847801-1-iscsi devstack@n-api.service[129472]: Mon Jun 27 16:10:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!